R Notebook

Problem1— Using ANN for Classifying News Articles

For this problem, we are going to use reuters dataset. It is a set of short newswires along with their topics published by Reuters in 1986. It is a simple, widely used toy dastaset for text classification. You are going to use a simple feedforward neural network to classify reuters news into 46 different topics/classes. The reuters dataset comes packaged as part of Keras . Import the dataset from keras using the following commands:

library(keras)
reuters = dataset_reuters(num_words=10000)

Take a look at the structure of reuters.dataset. The dataset is already pre-processed and split into train and test sets. Each example in the train or test set represents a news article and is stored as a list of integers where each integer represents the index of a specific word appearing in that article. When you set num_words=1000 in dataset_reuters, then keras keeps only the top 10000 most frequent words in the data. Let’s take a look at the structure of the training examples:

str(reuters$train$x)

List of 8982
 $ : int [1:87] 1 2 2 8 43 10 447 5 25 207 ...
 $ : int [1:56] 1 3267 699 3434 2295 56 2 7511 9 56 ...
 $ : int [1:139] 1 53 12 284 15 14 272 26 53 959 ...
 $ : int [1:224] 1 4 686 867 558 4 37 38 309 2276 ...
 $ : int [1:101] 1 8295 111 8 25 166 40 638 10 436 ...
 $ : int [1:116] 1 4 37 38 309 213 349 1632 48 193 ...
 $ : int [1:100] 1 56 5539 925 149 8 16 23 931 3875 ...
 $ : int [1:100] 1 53 648 26 14 749 26 39 6207 5466 ...
 $ : int [1:82] 1 178 53 321 26 14 948 26 178 39 ...
 $ : int [1:106] 1 56 7224 81 40 1175 174 2 6 1793 ...
 $ : int [1:31] 1 245 273 207 156 53 74 160 26 14 ...
 $ : int [1:59] 1 56 141 5618 1607 149 8 16 33 223 ...
 $ : int [1:65] 1 2 81 8 16 625 42 120 7 1679 ...
 $ : int [1:316] 1 248 409 166 1461 1284 3906 8 4 495 ...
 $ : int [1:527] 1 4 113 23 133 6 433 226 7 1182 ...
 $ : int [1:76] 1 577 9 355 430 21 4 2222 5 4 ...
 $ : int [1:114] 1 945 65 111 8 10 498 40 85 2120 ...
 $ : int [1:17] 1 486 341 785 26 14 482 26 255 606 ...
 $ : int [1:91] 1 53 19 296 15 14 258 26 53 959 ...
 $ : int [1:77] 1 7567 851 260 542 159 13 52 29 23 ...
 $ : int [1:231] 1 779 37 38 465 278 6623 55 900 6 ...
 $ : int [1:108] 1 73 418 904 2627 2198 8 36 717 271 ...
 $ : int [1:83] 1 2 71 8 16 385 6 42 904 103 ...
 $ : int [1:29] 1 245 273 397 124 53 191 26 14 83 ...
 $ : int [1:95] 1 29 6 207 156 169 103 858 131 74 ...
 $ : int [1:110] 1 144 62 2115 451 82 5 37 38 399 ...
 $ : int [1:23] 1 53 745 26 14 722 26 39 7442 18 ...
 $ : int [1:373] 1 10 545 856 3931 1187 2 33 1076 2045 ...
 $ : int [1:114] 1 178 53 279 26 14 124 26 178 39 ...
 $ : int [1:354] 1 2163 317 65 131 1462 23 768 1225 2 ...
 $ : int [1:133] 1 4 37 38 309 213 8 443 37 38 ...
 $ : int [1:222] 1 293 270 111 8 16 34 4814 27 3546 ...
 $ : int [1:571] 1 4 37 38 424 309 415 524 795 6 ...
 $ : int [1:155] 1 4 1795 232 60 240 128 140 21 68 ...
 $ : int [1:83] 1 4 37 38 23 6 3186 6526 841 11 ...
 $ : int [1:208] 1 1961 81 149 56 2 115 8 16 33 ...
 $ : int [1:170] 1 1378 234 99 610 60 8 4 60 1543 ...
 $ : int [1:269] 1 978 66 262 1251 2 8 107 4 293 ...
 $ : int [1:74] 1 29 6 94 156 89 67 2115 2453 14 ...
 $ : int [1:19] 1 486 341 119 26 14 119 26 7 255 ...
 $ : int [1:23] 1 53 258 26 14 187 26 39 3914 18 ...
 $ : int [1:78] 1 4 7085 66 253 2776 6 5345 11 15 ...
 $ : int [1:21] 1 599 1815 299 45 1320 194 198 2041 28 ...
 $ : int [1:377] 1 496 427 111 450 91 57 6 679 25 ...
 $ : int [1:104] 1 2856 56 2 626 450 8 16 40 129 ...
 $ : int [1:299] 1 4 37 38 431 8 25 1213 1957 5 ...
 $ : int [1:89] 1 2 442 101 13 104 34 68 20 217 ...
 $ : int [1:56] 1 155 822 62 3510 9 188 5104 7 42 ...
 $ : int [1:94] 1 60 5 130 1461 3366 1896 8 36 2464 ...
 $ : int [1:139] 1 53 284 26 14 319 39 47 5211 18 ...
 $ : int [1:118] 1 1479 1197 71 8 25 1479 1197 640 71 ...
 $ : int [1:36] 1 53 19 1090 15 14 1018 26 39 44 ...
 $ : int [1:137] 1 2185 921 9 1493 103 4971 1925 8 16 ...
 $ : int [1:107] 1 53 74 312 26 14 651 10 39 74 ...
 $ : int [1:83] 1 537 232 1231 537 232 703 111 8 16 ...
 $ : int [1:66] 1 53 191 26 14 158 26 39 19 3412 ...
 $ : int [1:70] 1 53 46 142 26 14 46 155 26 39 ...
 $ : int [1:112] 1 7674 2 71 8 16 2892 3514 1620 2357 ...
 $ : int [1:88] 1 2626 141 450 56 2626 626 8 16 64 ...
 $ : int [1:51] 1 53 767 26 14 124 26 39 72 2756 ...
 $ : int [1:83] 1 56 735 268 626 71 8 16 41 2049 ...
 $ : int [1:123] 1 2 231 81 8 16 638 42 3699 322 ...
 $ : int [1:17] 1 486 341 312 26 14 312 26 255 219 ...
 $ : int [1:185] 1 1537 9347 534 45 6 761 13 10 393 ...
 $ : int [1:84] 1 1284 5682 136 484 5 789 8 54 2395 ...
 $ : int [1:52] 1 218 430 21 4 2222 5 181 37 38 ...
 $ : int [1:102] 1 56 5539 925 149 8 25 116 13 12 ...
 $ : int [1:73] 1 2 752 13 234 867 247 79 8 16 ...
 $ : int [1:106] 1 56 1621 3922 9 1229 81 5662 369 25 ...
 $ : int [1:486] 1 367 40 2575 1470 6 30 7 538 5 ...
 $ : int [1:107] 1 2 691 149 8 2 600 822 28 25 ...
 $ : int [1:82] 1 53 751 26 14 648 26 39 482 32 ...
 $ : int [1:263] 1 802 64 10 4478 66 253 5 32 59 ...
 $ : int [1:172] 1 6475 214 71 8 25 362 23 7326 6 ...
 $ : int [1:491] 1 569 40 129 306 572 13 25 357 162 ...
 $ : int [1:190] 1 5985 2861 282 5 2883 9037 28 153 48 ...
 $ : int [1:143] 1 2173 3174 2841 491 8 2478 3638 2383 3096 ...
 $ : int [1:62] 1 4 294 259 1613 16 3308 4 198 5 ...
 $ : int [1:26] 1 4 497 81 8 4 354 598 846 1227 ...
 $ : int [1:88] 1 2 111 8 56 9891 2 5 2 192 ...
 $ : int [1:114] 1 1139 357 162 114 513 6 258 11 1232 ...
 $ : int [1:38] 1 53 272 26 14 158 26 39 32 3125 ...
 $ : int [1:85] 1 53 284 26 14 684 26 39 19 7103 ...
 $ : int [1:112] 1 4 37 38 740 291 1098 1641 40 1175 ...
 $ : int [1:793] 1 37 412 128 140 1431 306 6 449 246 ...
 $ : int [1:104] 1 178 53 46 142 26 14 46 319 2 ...
 $ : int [1:25] 1 53 321 26 14 614 26 39 19 3611 ...
 $ : int [1:21] 1 486 341 61 19 32 26 14 61 19 ...
 $ : int [1:101] 1 56 1100 392 149 785 20 324 27 1406 ...
 $ : int [1:28] 1 53 684 26 14 648 26 39 19 1746 ...
 $ : int [1:25] 1 2 1568 81 8 25 166 887 10 142 ...
 $ : int [1:81] 1 8521 81 384 4 8962 1029 111 8 16 ...
 $ : int [1:135] 1 53 750 26 14 644 26 39 758 980 ...
 $ : int [1:73] 1 56 234 1829 81 8 16 40 471 10 ...
 $ : int [1:62] 1 6120 23 772 6 334 93 187 13 10 ...
 $ : int [1:18] 1 486 341 158 44 26 14 158 44 26 ...
 $ : int [1:90] 1 4 237 259 1064 137 1386 13 664 76 ...
 $ : int [1:266] 1 4263 2162 81 8 24 25 731 1092 5 ...
 $ : int [1:91] 1 4 248 409 23 133 6 2156 4 106 ...
  [list output truncated]

This means that the first article consists of the words with indices 1,2,2,8,etc. As you can see, the examples in the train and test data are vectors of varying lengths. Neural Networks requires a matrix where each row represents an example and each column represent an attribute of that example. Therefore, to prepare this data for neural networks we need to make sure that all examples have the same number of columns ( that is, they are vectors of the same length). To do this, we do one- hot encoding of each example to turn them into vectors of 0s and 1s. This would mean for instance, turning the sequence [1,2,2,8,….] into a 10000 dimensional vector that would be all zeros except for indices 1,2,8, etc. In other words, we turn each news article into a 10000 dimensional binary vector which indicates which of the top 10000 frequent words occur in that article. You can use the following r function to do this one-hot-encoding:

one_hot_encoding = function(x, dimension=10000) {
  encoded = matrix(0, length(x), dimension)
  for (i in 1:length(x))
  encoded[i, x[[i]]] = 1
  encoded
}

Where x is the list of examples for which you want to do one-hot-encoding. Call this function on reuters$train$x and reuters$test$x to get the one-hot encoding of the train and test examples. This will produce a matrix with dimensions (8982,10000) for the train data and a matrix with dimensions(2246, 10000) for the test data. You can now use these matrices to train and test your neural network model.

reuters_train = one_hot_encoding(reuters$train$x)
reuters_test = one_hot_encoding(reuters$test$x)

Q1. (5 pts) Create an ANN model to classify reuters news article into 46 classes (note that reuters$train$y and reuters$test$y are vectors of integers between 0-45 representing the category of each news article). Use at least two hidden layers and compute the accuracy of your model on the test set. Unlike the fashion Mnist dataset where each image had to be flattened into a one dimensional vector, for the reuters dataset, you do not need the flatten layer before the dense layer as each observation (news article) is already one dimensional.

model <- keras_model_sequential()
model %>%
        layer_dense( units = 50, activation = "relu", input_shape = 10000) %>%
        layer_dense( units = 50, activation = "relu") %>%
        layer_dense( units = 50, activation = "relu") %>%
        layer_dense(units = 46, activation = 'softmax')

set.seed(123)
model %>% compile (
     loss = 'sparse_categorical_crossentropy',
     optimizer = 'adam',
     metrics = 'accuracy')

history = model %>% fit (x = reuters_train, y = reuters$train$y)

Epoch 1/10

  1/281 [..............................] - ETA: 0s - loss: 3.8428 - accuracy: 0.0000e+00
 24/281 [=>............................] - ETA: 0s - loss: 3.5910 - accuracy: 0.3542    
 47/281 [====>.........................] - ETA: 0s - loss: 2.9548 - accuracy: 0.4481
 71/281 [======>.......................] - ETA: 0s - loss: 2.5494 - accuracy: 0.4916
 95/281 [=========>....................] - ETA: 0s - loss: 2.3066 - accuracy: 0.5273
120/281 [===========>..................] - ETA: 0s - loss: 2.1028 - accuracy: 0.5651
147/281 [==============>...............] - ETA: 0s - loss: 1.9561 - accuracy: 0.5899
175/281 [=================>............] - ETA: 0s - loss: 1.8568 - accuracy: 0.6080
203/281 [====================>.........] - ETA: 0s - loss: 1.7395 - accuracy: 0.6304
231/281 [=======================>......] - ETA: 0s - loss: 1.6817 - accuracy: 0.6423
259/281 [==========================>...] - ETA: 0s - loss: 1.6272 - accuracy: 0.6514
281/281 [==============================] - 1s 2ms/step - loss: 1.5932 - accuracy: 0.6579

281/281 [==============================] - 1s 4ms/step - loss: 1.5932 - accuracy: 0.6579
Epoch 2/10

  1/281 [..............................] - ETA: 0s - loss: 1.1482 - accuracy: 0.7188
 24/281 [=>............................] - ETA: 0s - loss: 0.8123 - accuracy: 0.8242
 50/281 [====>.........................] - ETA: 0s - loss: 0.7735 - accuracy: 0.8325
 77/281 [=======>......................] - ETA: 0s - loss: 0.7468 - accuracy: 0.8356
105/281 [==========>...................] - ETA: 0s - loss: 0.7432 - accuracy: 0.8336
133/281 [=============>................] - ETA: 0s - loss: 0.7274 - accuracy: 0.8341
160/281 [================>.............] - ETA: 0s - loss: 0.7252 - accuracy: 0.8354
188/281 [===================>..........] - ETA: 0s - loss: 0.7232 - accuracy: 0.8374
216/281 [======================>.......] - ETA: 0s - loss: 0.7110 - accuracy: 0.8394
244/281 [=========================>....] - ETA: 0s - loss: 0.7027 - accuracy: 0.8402
272/281 [============================>.] - ETA: 0s - loss: 0.7066 - accuracy: 0.8394
281/281 [==============================] - 1s 2ms/step - loss: 0.7023 - accuracy: 0.8406

281/281 [==============================] - 1s 2ms/step - loss: 0.7023 - accuracy: 0.8406
Epoch 3/10

  1/281 [..............................] - ETA: 0s - loss: 0.3725 - accuracy: 0.9375
 25/281 [=>............................] - ETA: 0s - loss: 0.4201 - accuracy: 0.9075
 51/281 [====>.........................] - ETA: 0s - loss: 0.4014 - accuracy: 0.9118
 79/281 [=======>......................] - ETA: 0s - loss: 0.3645 - accuracy: 0.9197
107/281 [==========>...................] - ETA: 0s - loss: 0.3640 - accuracy: 0.9197
133/281 [=============>................] - ETA: 0s - loss: 0.3707 - accuracy: 0.9189
160/281 [================>.............] - ETA: 0s - loss: 0.3716 - accuracy: 0.9199
188/281 [===================>..........] - ETA: 0s - loss: 0.3724 - accuracy: 0.9190
215/281 [=====================>........] - ETA: 0s - loss: 0.3805 - accuracy: 0.9172
243/281 [========================>.....] - ETA: 0s - loss: 0.3821 - accuracy: 0.9162
271/281 [===========================>..] - ETA: 0s - loss: 0.3921 - accuracy: 0.9126
281/281 [==============================] - 1s 2ms/step - loss: 0.3926 - accuracy: 0.9126

281/281 [==============================] - 1s 2ms/step - loss: 0.3926 - accuracy: 0.9126
Epoch 4/10

  1/281 [..............................] - ETA: 0s - loss: 0.0553 - accuracy: 1.0000
 26/281 [=>............................] - ETA: 0s - loss: 0.2353 - accuracy: 0.9519
 52/281 [====>.........................] - ETA: 0s - loss: 0.2488 - accuracy: 0.9441
 80/281 [=======>......................] - ETA: 0s - loss: 0.2353 - accuracy: 0.9492
108/281 [==========>...................] - ETA: 0s - loss: 0.2579 - accuracy: 0.9427
134/281 [=============>................] - ETA: 0s - loss: 0.2542 - accuracy: 0.9436
160/281 [================>.............] - ETA: 0s - loss: 0.2551 - accuracy: 0.9426
186/281 [==================>...........] - ETA: 0s - loss: 0.2587 - accuracy: 0.9417
211/281 [=====================>........] - ETA: 0s - loss: 0.2588 - accuracy: 0.9408
237/281 [========================>.....] - ETA: 0s - loss: 0.2629 - accuracy: 0.9392
263/281 [===========================>..] - ETA: 0s - loss: 0.2694 - accuracy: 0.9376
281/281 [==============================] - 1s 2ms/step - loss: 0.2722 - accuracy: 0.9367

281/281 [==============================] - 1s 2ms/step - loss: 0.2722 - accuracy: 0.9367
Epoch 5/10

  1/281 [..............................] - ETA: 0s - loss: 0.2607 - accuracy: 0.9375
 18/281 [>.............................] - ETA: 0s - loss: 0.1869 - accuracy: 0.9549
 40/281 [===>..........................] - ETA: 0s - loss: 0.1634 - accuracy: 0.9555
 64/281 [=====>........................] - ETA: 0s - loss: 0.1593 - accuracy: 0.9561
 91/281 [========>.....................] - ETA: 0s - loss: 0.1723 - accuracy: 0.9540
118/281 [===========>..................] - ETA: 0s - loss: 0.1799 - accuracy: 0.9518
144/281 [==============>...............] - ETA: 0s - loss: 0.1950 - accuracy: 0.9475
172/281 [=================>............] - ETA: 0s - loss: 0.1930 - accuracy: 0.9486
200/281 [====================>.........] - ETA: 0s - loss: 0.2053 - accuracy: 0.9461
228/281 [=======================>......] - ETA: 0s - loss: 0.2067 - accuracy: 0.9460
256/281 [==========================>...] - ETA: 0s - loss: 0.2063 - accuracy: 0.9458
281/281 [==============================] - 1s 2ms/step - loss: 0.2074 - accuracy: 0.9457

281/281 [==============================] - 1s 2ms/step - loss: 0.2074 - accuracy: 0.9457
Epoch 6/10

  1/281 [..............................] - ETA: 0s - loss: 0.1647 - accuracy: 0.9375
 24/281 [=>............................] - ETA: 0s - loss: 0.1479 - accuracy: 0.9583
 50/281 [====>.........................] - ETA: 0s - loss: 0.1566 - accuracy: 0.9544
 76/281 [=======>......................] - ETA: 0s - loss: 0.1628 - accuracy: 0.9535
101/281 [=========>....................] - ETA: 0s - loss: 0.1553 - accuracy: 0.9548
127/281 [============>.................] - ETA: 0s - loss: 0.1638 - accuracy: 0.9523
152/281 [===============>..............] - ETA: 0s - loss: 0.1633 - accuracy: 0.9533
176/281 [=================>............] - ETA: 0s - loss: 0.1642 - accuracy: 0.9531
204/281 [====================>.........] - ETA: 0s - loss: 0.1696 - accuracy: 0.9510
232/281 [=======================>......] - ETA: 0s - loss: 0.1724 - accuracy: 0.9507
260/281 [==========================>...] - ETA: 0s - loss: 0.1762 - accuracy: 0.9498
281/281 [==============================] - 1s 2ms/step - loss: 0.1781 - accuracy: 0.9492

281/281 [==============================] - 1s 2ms/step - loss: 0.1781 - accuracy: 0.9492
Epoch 7/10

  1/281 [..............................] - ETA: 0s - loss: 0.1259 - accuracy: 0.9375
 24/281 [=>............................] - ETA: 0s - loss: 0.1335 - accuracy: 0.9570
 48/281 [====>.........................] - ETA: 0s - loss: 0.1134 - accuracy: 0.9661
 75/281 [=======>......................] - ETA: 0s - loss: 0.1317 - accuracy: 0.9596
102/281 [=========>....................] - ETA: 0s - loss: 0.1357 - accuracy: 0.9586
129/281 [============>.................] - ETA: 0s - loss: 0.1325 - accuracy: 0.9581
156/281 [===============>..............] - ETA: 0s - loss: 0.1369 - accuracy: 0.9579
183/281 [==================>...........] - ETA: 0s - loss: 0.1427 - accuracy: 0.9563
210/281 [=====================>........] - ETA: 0s - loss: 0.1467 - accuracy: 0.9545
238/281 [========================>.....] - ETA: 0s - loss: 0.1494 - accuracy: 0.9543
265/281 [===========================>..] - ETA: 0s - loss: 0.1511 - accuracy: 0.9528
281/281 [==============================] - 1s 2ms/step - loss: 0.1559 - accuracy: 0.9515

281/281 [==============================] - 1s 2ms/step - loss: 0.1559 - accuracy: 0.9515
Epoch 8/10

  1/281 [..............................] - ETA: 0s - loss: 0.0224 - accuracy: 1.0000
 25/281 [=>............................] - ETA: 0s - loss: 0.1132 - accuracy: 0.9712
 48/281 [====>.........................] - ETA: 0s - loss: 0.1093 - accuracy: 0.9714
 72/281 [======>.......................] - ETA: 0s - loss: 0.1132 - accuracy: 0.9666
 97/281 [=========>....................] - ETA: 0s - loss: 0.1222 - accuracy: 0.9617
125/281 [============>.................] - ETA: 0s - loss: 0.1281 - accuracy: 0.9582
153/281 [===============>..............] - ETA: 0s - loss: 0.1289 - accuracy: 0.9577
181/281 [==================>...........] - ETA: 0s - loss: 0.1308 - accuracy: 0.9567
209/281 [=====================>........] - ETA: 0s - loss: 0.1331 - accuracy: 0.9550
237/281 [========================>.....] - ETA: 0s - loss: 0.1399 - accuracy: 0.9535
265/281 [===========================>..] - ETA: 0s - loss: 0.1405 - accuracy: 0.9537
281/281 [==============================] - 1s 2ms/step - loss: 0.1433 - accuracy: 0.9525

281/281 [==============================] - 1s 2ms/step - loss: 0.1433 - accuracy: 0.9525
Epoch 9/10

  1/281 [..............................] - ETA: 0s - loss: 0.2432 - accuracy: 0.9375
 25/281 [=>............................] - ETA: 0s - loss: 0.0989 - accuracy: 0.9663
 48/281 [====>.........................] - ETA: 0s - loss: 0.1005 - accuracy: 0.9668
 75/281 [=======>......................] - ETA: 0s - loss: 0.1075 - accuracy: 0.9629
102/281 [=========>....................] - ETA: 0s - loss: 0.1144 - accuracy: 0.9602
129/281 [============>.................] - ETA: 0s - loss: 0.1181 - accuracy: 0.9583
155/281 [===============>..............] - ETA: 0s - loss: 0.1263 - accuracy: 0.9560
181/281 [==================>...........] - ETA: 0s - loss: 0.1289 - accuracy: 0.9551
208/281 [=====================>........] - ETA: 0s - loss: 0.1327 - accuracy: 0.9539
236/281 [========================>.....] - ETA: 0s - loss: 0.1351 - accuracy: 0.9525
264/281 [===========================>..] - ETA: 0s - loss: 0.1348 - accuracy: 0.9527
281/281 [==============================] - 1s 2ms/step - loss: 0.1355 - accuracy: 0.9525

281/281 [==============================] - 1s 2ms/step - loss: 0.1355 - accuracy: 0.9525
Epoch 10/10

  1/281 [..............................] - ETA: 0s - loss: 0.0807 - accuracy: 0.9688
 24/281 [=>............................] - ETA: 0s - loss: 0.1136 - accuracy: 0.9622
 47/281 [====>.........................] - ETA: 0s - loss: 0.1105 - accuracy: 0.9594
 73/281 [======>.......................] - ETA: 0s - loss: 0.1194 - accuracy: 0.9576
101/281 [=========>....................] - ETA: 0s - loss: 0.1383 - accuracy: 0.9502
129/281 [============>.................] - ETA: 0s - loss: 0.1365 - accuracy: 0.9508
156/281 [===============>..............] - ETA: 0s - loss: 0.1320 - accuracy: 0.9529
184/281 [==================>...........] - ETA: 0s - loss: 0.1328 - accuracy: 0.9513
211/281 [=====================>........] - ETA: 0s - loss: 0.1296 - accuracy: 0.9519
237/281 [========================>.....] - ETA: 0s - loss: 0.1275 - accuracy: 0.9529
264/281 [===========================>..] - ETA: 0s - loss: 0.1291 - accuracy: 0.9525
281/281 [==============================] - 1s 2ms/step - loss: 0.1309 - accuracy: 0.9518

281/281 [==============================] - 1s 2ms/step - loss: 0.1309 - accuracy: 0.9518

score <- model %>% evaluate(reuters_test, reuters$test$y, verbose = 2)

71/71 - 0s - loss: 1.2323 - accuracy: 0.7898
71/71 - 0s - loss: 1.2323 - accuracy: 0.7898

cat('Test accuracy:', score[2], "\n")

Test accuracy: 0.7898486 

Q2. (5 pts) Split the train data into train/validation set. Use the first 1000 examples in reuters$train for validation and the rest for training your model. Use “tfruns” package to tune your ANN’s hyperparameters including, the number of nodes in each hidden layer, the activation function in each hidden layer, batch_size, learning_rate, and the number of epochs). Validate each model on the validation set.
Answer the following questions:
1- Which model ( which hyper-parameter combination) resulted in the best accuracy on the validation data? Make sure that you print the returned value from tfruns and report the
run with the highest validation accuracy.
2- Print the learning curve of your best model. Does your best model still overfit?
3- Does your validation_loss stop decreasing after several epochs? If so, at roughly which epoch
does your validation_loss stop decreasing?

reuters_validation_x = one_hot_encoding(reuters$train$x[1:1000])
validation_labels = reuters$train$y[1:1000]

reuters_train = one_hot_encoding(reuters$train$x[1001:length(reuters$train$x)])
reuters_train_labels = reuters$train$y[1001:length(reuters$train$y)]

library(tfruns)

runs <- tuning_run("reuters.R",
                   flags = list (
                     nodes = c(64, 128, 392),
                     learning_rate = c(0.01, 0.05, 0.001, 0.0001),
                     batch_size = c(100, 200, 500, 1000),
                     epochs = c(30,50,100),
                     activation = c("relu","sigmoid","tanh")
                   ), sample = 0.02)

432 total combinations of flags (sampled to 8 combinations)

y

Training run 1/8 (flags = list(64, 0.001, 500, 100, "tanh")) 
Using run directory runs/2020-11-01T18-47-32Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = 10000) %>%
+         layer_dense( units = FLAGS$n .... [TRUNCATED] 

> set.seed(123)

> model %>% compile (
+         loss = 'sparse_categorical_crossentropy',
+         optimizer = optimizer_adam(lr=FLAGS$learning_rate),
+         metr .... [TRUNCATED] 

> model %>% fit (x = reuters_train, y = reuters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = list(reuters_val .... [TRUNCATED] 
Epoch 1/100

 1/16 [>.............................] - ETA: 0s - loss: 3.8632 - accuracy: 0.0020
 6/16 [==========>...................] - ETA: 0s - loss: 3.4085 - accuracy: 0.3723
11/16 [===================>..........] - ETA: 0s - loss: 3.0368 - accuracy: 0.4416
16/16 [==============================] - 0s 12ms/step - loss: 2.7542 - accuracy: 0.4722

16/16 [==============================] - 1s 50ms/step - loss: 2.7542 - accuracy: 0.4722 - val_loss: 1.9499 - val_accuracy: 0.5590
Epoch 2/100

 1/16 [>.............................] - ETA: 0s - loss: 1.9185 - accuracy: 0.5720
 5/16 [========>.....................] - ETA: 0s - loss: 1.8056 - accuracy: 0.5992
 9/16 [===============>..............] - ETA: 0s - loss: 1.7617 - accuracy: 0.6053
13/16 [=======================>......] - ETA: 0s - loss: 1.6824 - accuracy: 0.6282
16/16 [==============================] - 0s 12ms/step - loss: 1.6490 - accuracy: 0.6384

16/16 [==============================] - 0s 22ms/step - loss: 1.6490 - accuracy: 0.6384 - val_loss: 1.4935 - val_accuracy: 0.6600
Epoch 3/100

 1/16 [>.............................] - ETA: 0s - loss: 1.3687 - accuracy: 0.7060
 5/16 [========>.....................] - ETA: 0s - loss: 1.2982 - accuracy: 0.7196
 9/16 [===============>..............] - ETA: 0s - loss: 1.2832 - accuracy: 0.7209
13/16 [=======================>......] - ETA: 0s - loss: 1.2736 - accuracy: 0.7183
16/16 [==============================] - 0s 12ms/step - loss: 1.2587 - accuracy: 0.7229

16/16 [==============================] - 0s 21ms/step - loss: 1.2587 - accuracy: 0.7229 - val_loss: 1.2458 - val_accuracy: 0.7180
Epoch 4/100

 1/16 [>.............................] - ETA: 0s - loss: 0.9853 - accuracy: 0.7900
 6/16 [==========>...................] - ETA: 0s - loss: 1.0010 - accuracy: 0.7850
11/16 [===================>..........] - ETA: 0s - loss: 1.0029 - accuracy: 0.7878
15/16 [===========================>..] - ETA: 0s - loss: 0.9864 - accuracy: 0.7932
16/16 [==============================] - 0s 12ms/step - loss: 0.9772 - accuracy: 0.7955

16/16 [==============================] - 0s 21ms/step - loss: 0.9772 - accuracy: 0.7955 - val_loss: 1.0916 - val_accuracy: 0.7540
Epoch 5/100

 1/16 [>.............................] - ETA: 0s - loss: 0.7793 - accuracy: 0.8680
 5/16 [========>.....................] - ETA: 0s - loss: 0.7997 - accuracy: 0.8552
 9/16 [===============>..............] - ETA: 0s - loss: 0.7698 - accuracy: 0.8624
13/16 [=======================>......] - ETA: 0s - loss: 0.7599 - accuracy: 0.8598
16/16 [==============================] - 0s 12ms/step - loss: 0.7560 - accuracy: 0.8606

16/16 [==============================] - 0s 21ms/step - loss: 0.7560 - accuracy: 0.8606 - val_loss: 0.9990 - val_accuracy: 0.7820
Epoch 6/100

 1/16 [>.............................] - ETA: 0s - loss: 0.7159 - accuracy: 0.8740
 5/16 [========>.....................] - ETA: 0s - loss: 0.6424 - accuracy: 0.8872
 9/16 [===============>..............] - ETA: 0s - loss: 0.6153 - accuracy: 0.8940
14/16 [=========================>....] - ETA: 0s - loss: 0.5913 - accuracy: 0.8963
16/16 [==============================] - 0s 12ms/step - loss: 0.5904 - accuracy: 0.8961

16/16 [==============================] - 0s 21ms/step - loss: 0.5904 - accuracy: 0.8961 - val_loss: 0.9481 - val_accuracy: 0.7990
Epoch 7/100

 1/16 [>.............................] - ETA: 0s - loss: 0.4716 - accuracy: 0.9260
 5/16 [========>.....................] - ETA: 0s - loss: 0.4896 - accuracy: 0.9224
 9/16 [===============>..............] - ETA: 0s - loss: 0.4775 - accuracy: 0.9222
13/16 [=======================>......] - ETA: 0s - loss: 0.4741 - accuracy: 0.9202
16/16 [==============================] - 0s 13ms/step - loss: 0.4654 - accuracy: 0.9198

16/16 [==============================] - 0s 23ms/step - loss: 0.4654 - accuracy: 0.9198 - val_loss: 0.9138 - val_accuracy: 0.8010
Epoch 8/100

 1/16 [>.............................] - ETA: 0s - loss: 0.4121 - accuracy: 0.9340
 5/16 [========>.....................] - ETA: 0s - loss: 0.3835 - accuracy: 0.9368
 9/16 [===============>..............] - ETA: 0s - loss: 0.3809 - accuracy: 0.9351
13/16 [=======================>......] - ETA: 0s - loss: 0.3752 - accuracy: 0.9369
16/16 [==============================] - 0s 13ms/step - loss: 0.3708 - accuracy: 0.9359

16/16 [==============================] - 0s 22ms/step - loss: 0.3708 - accuracy: 0.9359 - val_loss: 0.9010 - val_accuracy: 0.8010
Epoch 9/100

 1/16 [>.............................] - ETA: 0s - loss: 0.3219 - accuracy: 0.9440
 5/16 [========>.....................] - ETA: 0s - loss: 0.3110 - accuracy: 0.9496
 9/16 [===============>..............] - ETA: 0s - loss: 0.3109 - accuracy: 0.9489
13/16 [=======================>......] - ETA: 0s - loss: 0.3063 - accuracy: 0.9472
16/16 [==============================] - 0s 12ms/step - loss: 0.3030 - accuracy: 0.9460

16/16 [==============================] - 0s 22ms/step - loss: 0.3030 - accuracy: 0.9460 - val_loss: 0.8879 - val_accuracy: 0.8040
Epoch 10/100

 1/16 [>.............................] - ETA: 0s - loss: 0.2327 - accuracy: 0.9640
 5/16 [========>.....................] - ETA: 0s - loss: 0.2468 - accuracy: 0.9564
 9/16 [===============>..............] - ETA: 0s - loss: 0.2479 - accuracy: 0.9542
13/16 [=======================>......] - ETA: 0s - loss: 0.2535 - accuracy: 0.9525
16/16 [==============================] - 0s 13ms/step - loss: 0.2524 - accuracy: 0.9515

16/16 [==============================] - 0s 22ms/step - loss: 0.2524 - accuracy: 0.9515 - val_loss: 0.8950 - val_accuracy: 0.8040
Epoch 11/100

 1/16 [>.............................] - ETA: 0s - loss: 0.1877 - accuracy: 0.9540
 5/16 [========>.....................] - ETA: 0s - loss: 0.2059 - accuracy: 0.9596
 9/16 [===============>..............] - ETA: 0s - loss: 0.2093 - accuracy: 0.9580
14/16 [=========================>....] - ETA: 0s - loss: 0.2126 - accuracy: 0.9551
16/16 [==============================] - 0s 12ms/step - loss: 0.2134 - accuracy: 0.9546

16/16 [==============================] - 0s 21ms/step - loss: 0.2134 - accuracy: 0.9546 - val_loss: 0.8958 - val_accuracy: 0.8040
Epoch 12/100

 1/16 [>.............................] - ETA: 0s - loss: 0.1896 - accuracy: 0.9560
 5/16 [========>.....................] - ETA: 0s - loss: 0.1811 - accuracy: 0.9636
 9/16 [===============>..............] - ETA: 0s - loss: 0.1836 - accuracy: 0.9618
14/16 [=========================>....] - ETA: 0s - loss: 0.1844 - accuracy: 0.9583
16/16 [==============================] - 0s 12ms/step - loss: 0.1857 - accuracy: 0.9573

16/16 [==============================] - 0s 21ms/step - loss: 0.1857 - accuracy: 0.9573 - val_loss: 0.9034 - val_accuracy: 0.8010
Epoch 13/100

 1/16 [>.............................] - ETA: 0s - loss: 0.1788 - accuracy: 0.9480
 5/16 [========>.....................] - ETA: 0s - loss: 0.1516 - accuracy: 0.9608
 9/16 [===============>..............] - ETA: 0s - loss: 0.1550 - accuracy: 0.9618
13/16 [=======================>......] - ETA: 0s - loss: 0.1622 - accuracy: 0.9592
16/16 [==============================] - 0s 12ms/step - loss: 0.1649 - accuracy: 0.9568

16/16 [==============================] - 0s 22ms/step - loss: 0.1649 - accuracy: 0.9568 - val_loss: 0.9126 - val_accuracy: 0.8010
Epoch 14/100

 1/16 [>.............................] - ETA: 0s - loss: 0.1328 - accuracy: 0.9720
 5/16 [========>.....................] - ETA: 0s - loss: 0.1449 - accuracy: 0.9644
10/16 [=================>............] - ETA: 0s - loss: 0.1398 - accuracy: 0.9638
15/16 [===========================>..] - ETA: 0s - loss: 0.1442 - accuracy: 0.9612
16/16 [==============================] - 0s 12ms/step - loss: 0.1438 - accuracy: 0.9610

16/16 [==============================] - 0s 21ms/step - loss: 0.1438 - accuracy: 0.9610 - val_loss: 0.9186 - val_accuracy: 0.7950
Epoch 15/100

 1/16 [>.............................] - ETA: 0s - loss: 0.1180 - accuracy: 0.9740
 6/16 [==========>...................] - ETA: 0s - loss: 0.1263 - accuracy: 0.9667
11/16 [===================>..........] - ETA: 0s - loss: 0.1243 - accuracy: 0.9649
15/16 [===========================>..] - ETA: 0s - loss: 0.1288 - accuracy: 0.9616
16/16 [==============================] - 0s 11ms/step - loss: 0.1305 - accuracy: 0.9604

16/16 [==============================] - 0s 21ms/step - loss: 0.1305 - accuracy: 0.9604 - val_loss: 0.9316 - val_accuracy: 0.7930
Epoch 16/100

 1/16 [>.............................] - ETA: 0s - loss: 0.1143 - accuracy: 0.9740
 6/16 [==========>...................] - ETA: 0s - loss: 0.1117 - accuracy: 0.9653
10/16 [=================>............] - ETA: 0s - loss: 0.1084 - accuracy: 0.9660
14/16 [=========================>....] - ETA: 0s - loss: 0.1172 - accuracy: 0.9611
16/16 [==============================] - 0s 12ms/step - loss: 0.1192 - accuracy: 0.9599

16/16 [==============================] - 0s 21ms/step - loss: 0.1192 - accuracy: 0.9599 - val_loss: 0.9435 - val_accuracy: 0.7940
Epoch 17/100

 1/16 [>.............................] - ETA: 0s - loss: 0.1016 - accuracy: 0.9660
 5/16 [========>.....................] - ETA: 0s - loss: 0.0982 - accuracy: 0.9672
 9/16 [===============>..............] - ETA: 0s - loss: 0.1020 - accuracy: 0.9658
13/16 [=======================>......] - ETA: 0s - loss: 0.1038 - accuracy: 0.9634
16/16 [==============================] - 0s 13ms/step - loss: 0.1115 - accuracy: 0.9602

16/16 [==============================] - 0s 22ms/step - loss: 0.1115 - accuracy: 0.9602 - val_loss: 0.9554 - val_accuracy: 0.7940
Epoch 18/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0879 - accuracy: 0.9660
 5/16 [========>.....................] - ETA: 0s - loss: 0.0884 - accuracy: 0.9696
 9/16 [===============>..............] - ETA: 0s - loss: 0.0928 - accuracy: 0.9671
13/16 [=======================>......] - ETA: 0s - loss: 0.1013 - accuracy: 0.9632
16/16 [==============================] - 0s 13ms/step - loss: 0.1049 - accuracy: 0.9610

16/16 [==============================] - 0s 22ms/step - loss: 0.1049 - accuracy: 0.9610 - val_loss: 0.9672 - val_accuracy: 0.7960
Epoch 19/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0919 - accuracy: 0.9700
 6/16 [==========>...................] - ETA: 0s - loss: 0.0850 - accuracy: 0.9730
10/16 [=================>............] - ETA: 0s - loss: 0.0932 - accuracy: 0.9668
14/16 [=========================>....] - ETA: 0s - loss: 0.0959 - accuracy: 0.9636
16/16 [==============================] - 0s 12ms/step - loss: 0.0982 - accuracy: 0.9614

16/16 [==============================] - 0s 22ms/step - loss: 0.0982 - accuracy: 0.9614 - val_loss: 0.9632 - val_accuracy: 0.7950
Epoch 20/100

 1/16 [>.............................] - ETA: 0s - loss: 0.1006 - accuracy: 0.9580
 5/16 [========>.....................] - ETA: 0s - loss: 0.0903 - accuracy: 0.9660
 9/16 [===============>..............] - ETA: 0s - loss: 0.0855 - accuracy: 0.9684
14/16 [=========================>....] - ETA: 0s - loss: 0.0903 - accuracy: 0.9639
16/16 [==============================] - 0s 12ms/step - loss: 0.0949 - accuracy: 0.9613

16/16 [==============================] - 0s 21ms/step - loss: 0.0949 - accuracy: 0.9613 - val_loss: 0.9776 - val_accuracy: 0.7980
Epoch 21/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0629 - accuracy: 0.9780
 5/16 [========>.....................] - ETA: 0s - loss: 0.0730 - accuracy: 0.9724
10/16 [=================>............] - ETA: 0s - loss: 0.0845 - accuracy: 0.9646
15/16 [===========================>..] - ETA: 0s - loss: 0.0894 - accuracy: 0.9613
16/16 [==============================] - 0s 11ms/step - loss: 0.0915 - accuracy: 0.9605

16/16 [==============================] - 0s 21ms/step - loss: 0.0915 - accuracy: 0.9605 - val_loss: 0.9833 - val_accuracy: 0.7970
Epoch 22/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0864 - accuracy: 0.9700
 6/16 [==========>...................] - ETA: 0s - loss: 0.0853 - accuracy: 0.9670
11/16 [===================>..........] - ETA: 0s - loss: 0.0837 - accuracy: 0.9662
15/16 [===========================>..] - ETA: 0s - loss: 0.0873 - accuracy: 0.9632
16/16 [==============================] - 0s 11ms/step - loss: 0.0896 - accuracy: 0.9620

16/16 [==============================] - 0s 21ms/step - loss: 0.0896 - accuracy: 0.9620 - val_loss: 0.9849 - val_accuracy: 0.7970
Epoch 23/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0651 - accuracy: 0.9680
 5/16 [========>.....................] - ETA: 0s - loss: 0.0748 - accuracy: 0.9648
 9/16 [===============>..............] - ETA: 0s - loss: 0.0763 - accuracy: 0.9644
13/16 [=======================>......] - ETA: 0s - loss: 0.0805 - accuracy: 0.9629
16/16 [==============================] - 0s 12ms/step - loss: 0.0860 - accuracy: 0.9597

16/16 [==============================] - 0s 21ms/step - loss: 0.0860 - accuracy: 0.9597 - val_loss: 0.9989 - val_accuracy: 0.7940
Epoch 24/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0772 - accuracy: 0.9620
 5/16 [========>.....................] - ETA: 0s - loss: 0.0760 - accuracy: 0.9636
 9/16 [===============>..............] - ETA: 0s - loss: 0.0749 - accuracy: 0.9640
14/16 [=========================>....] - ETA: 0s - loss: 0.0811 - accuracy: 0.9603
16/16 [==============================] - 0s 12ms/step - loss: 0.0825 - accuracy: 0.9592

16/16 [==============================] - 0s 21ms/step - loss: 0.0825 - accuracy: 0.9592 - val_loss: 1.0110 - val_accuracy: 0.7880
Epoch 25/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0679 - accuracy: 0.9720
 5/16 [========>.....................] - ETA: 0s - loss: 0.0691 - accuracy: 0.9720
10/16 [=================>............] - ETA: 0s - loss: 0.0734 - accuracy: 0.9660
15/16 [===========================>..] - ETA: 0s - loss: 0.0794 - accuracy: 0.9617
16/16 [==============================] - 0s 12ms/step - loss: 0.0811 - accuracy: 0.9604

16/16 [==============================] - 0s 21ms/step - loss: 0.0811 - accuracy: 0.9604 - val_loss: 0.9951 - val_accuracy: 0.8030
Epoch 26/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0791 - accuracy: 0.9660
 6/16 [==========>...................] - ETA: 0s - loss: 0.0736 - accuracy: 0.9687
10/16 [=================>............] - ETA: 0s - loss: 0.0739 - accuracy: 0.9674
14/16 [=========================>....] - ETA: 0s - loss: 0.0746 - accuracy: 0.9651
16/16 [==============================] - 0s 12ms/step - loss: 0.0778 - accuracy: 0.9624

16/16 [==============================] - 0s 21ms/step - loss: 0.0778 - accuracy: 0.9624 - val_loss: 1.0181 - val_accuracy: 0.7910
Epoch 27/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0535 - accuracy: 0.9780
 6/16 [==========>...................] - ETA: 0s - loss: 0.0662 - accuracy: 0.9697
10/16 [=================>............] - ETA: 0s - loss: 0.0656 - accuracy: 0.9684
15/16 [===========================>..] - ETA: 0s - loss: 0.0762 - accuracy: 0.9611
16/16 [==============================] - 0s 11ms/step - loss: 0.0760 - accuracy: 0.9604

16/16 [==============================] - 0s 21ms/step - loss: 0.0760 - accuracy: 0.9604 - val_loss: 1.0292 - val_accuracy: 0.7900
Epoch 28/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0865 - accuracy: 0.9580
 6/16 [==========>...................] - ETA: 0s - loss: 0.0685 - accuracy: 0.9667
10/16 [=================>............] - ETA: 0s - loss: 0.0747 - accuracy: 0.9612
14/16 [=========================>....] - ETA: 0s - loss: 0.0735 - accuracy: 0.9613
16/16 [==============================] - 0s 12ms/step - loss: 0.0746 - accuracy: 0.9598

16/16 [==============================] - 0s 21ms/step - loss: 0.0746 - accuracy: 0.9598 - val_loss: 1.0223 - val_accuracy: 0.7980
Epoch 29/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0749 - accuracy: 0.9620
 5/16 [========>.....................] - ETA: 0s - loss: 0.0687 - accuracy: 0.9644
10/16 [=================>............] - ETA: 0s - loss: 0.0664 - accuracy: 0.9654
15/16 [===========================>..] - ETA: 0s - loss: 0.0730 - accuracy: 0.9603
16/16 [==============================] - 0s 12ms/step - loss: 0.0747 - accuracy: 0.9590

16/16 [==============================] - 0s 21ms/step - loss: 0.0747 - accuracy: 0.9590 - val_loss: 1.0363 - val_accuracy: 0.7950
Epoch 30/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0561 - accuracy: 0.9780
 6/16 [==========>...................] - ETA: 0s - loss: 0.0705 - accuracy: 0.9630
10/16 [=================>............] - ETA: 0s - loss: 0.0670 - accuracy: 0.9650
15/16 [===========================>..] - ETA: 0s - loss: 0.0719 - accuracy: 0.9607
16/16 [==============================] - 0s 12ms/step - loss: 0.0730 - accuracy: 0.9599

16/16 [==============================] - 0s 21ms/step - loss: 0.0730 - accuracy: 0.9599 - val_loss: 1.0409 - val_accuracy: 0.7970
Epoch 31/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0573 - accuracy: 0.9740
 5/16 [========>.....................] - ETA: 0s - loss: 0.0634 - accuracy: 0.9684
 9/16 [===============>..............] - ETA: 0s - loss: 0.0654 - accuracy: 0.9653
13/16 [=======================>......] - ETA: 0s - loss: 0.0677 - accuracy: 0.9628
16/16 [==============================] - 0s 12ms/step - loss: 0.0711 - accuracy: 0.9612

16/16 [==============================] - 0s 21ms/step - loss: 0.0711 - accuracy: 0.9612 - val_loss: 1.0483 - val_accuracy: 0.7940
Epoch 32/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0513 - accuracy: 0.9800
 6/16 [==========>...................] - ETA: 0s - loss: 0.0619 - accuracy: 0.9710
11/16 [===================>..........] - ETA: 0s - loss: 0.0685 - accuracy: 0.9640
15/16 [===========================>..] - ETA: 0s - loss: 0.0700 - accuracy: 0.9624
16/16 [==============================] - 0s 11ms/step - loss: 0.0706 - accuracy: 0.9622

16/16 [==============================] - 0s 20ms/step - loss: 0.0706 - accuracy: 0.9622 - val_loss: 1.0420 - val_accuracy: 0.8010
Epoch 33/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0732 - accuracy: 0.9660
 5/16 [========>.....................] - ETA: 0s - loss: 0.0675 - accuracy: 0.9660
 9/16 [===============>..............] - ETA: 0s - loss: 0.0675 - accuracy: 0.9649
13/16 [=======================>......] - ETA: 0s - loss: 0.0658 - accuracy: 0.9652
16/16 [==============================] - 0s 12ms/step - loss: 0.0688 - accuracy: 0.9618

16/16 [==============================] - 0s 21ms/step - loss: 0.0688 - accuracy: 0.9618 - val_loss: 1.0553 - val_accuracy: 0.7950
Epoch 34/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0640 - accuracy: 0.9700
 5/16 [========>.....................] - ETA: 0s - loss: 0.0618 - accuracy: 0.9668
 9/16 [===============>..............] - ETA: 0s - loss: 0.0627 - accuracy: 0.9669
13/16 [=======================>......] - ETA: 0s - loss: 0.0679 - accuracy: 0.9626
16/16 [==============================] - 0s 12ms/step - loss: 0.0687 - accuracy: 0.9615

16/16 [==============================] - 0s 21ms/step - loss: 0.0687 - accuracy: 0.9615 - val_loss: 1.0589 - val_accuracy: 0.7980
Epoch 35/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0597 - accuracy: 0.9740
 5/16 [========>.....................] - ETA: 0s - loss: 0.0593 - accuracy: 0.9700
 9/16 [===============>..............] - ETA: 0s - loss: 0.0607 - accuracy: 0.9669
14/16 [=========================>....] - ETA: 0s - loss: 0.0645 - accuracy: 0.9634
16/16 [==============================] - 0s 12ms/step - loss: 0.0682 - accuracy: 0.9612

16/16 [==============================] - 0s 22ms/step - loss: 0.0682 - accuracy: 0.9612 - val_loss: 1.0638 - val_accuracy: 0.7950
Epoch 36/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0643 - accuracy: 0.9660
 6/16 [==========>...................] - ETA: 0s - loss: 0.0584 - accuracy: 0.9677
10/16 [=================>............] - ETA: 0s - loss: 0.0592 - accuracy: 0.9666
14/16 [=========================>....] - ETA: 0s - loss: 0.0641 - accuracy: 0.9636
16/16 [==============================] - 0s 12ms/step - loss: 0.0676 - accuracy: 0.9613

16/16 [==============================] - 0s 21ms/step - loss: 0.0676 - accuracy: 0.9613 - val_loss: 1.0663 - val_accuracy: 0.8000
Epoch 37/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0480 - accuracy: 0.9780
 5/16 [========>.....................] - ETA: 0s - loss: 0.0572 - accuracy: 0.9704
 9/16 [===============>..............] - ETA: 0s - loss: 0.0588 - accuracy: 0.9676
13/16 [=======================>......] - ETA: 0s - loss: 0.0629 - accuracy: 0.9643
16/16 [==============================] - 0s 12ms/step - loss: 0.0650 - accuracy: 0.9620

16/16 [==============================] - 0s 21ms/step - loss: 0.0650 - accuracy: 0.9620 - val_loss: 1.0679 - val_accuracy: 0.7960
Epoch 38/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0526 - accuracy: 0.9700
 6/16 [==========>...................] - ETA: 0s - loss: 0.0573 - accuracy: 0.9680
11/16 [===================>..........] - ETA: 0s - loss: 0.0638 - accuracy: 0.9622
16/16 [==============================] - 0s 11ms/step - loss: 0.0653 - accuracy: 0.9599

16/16 [==============================] - 0s 21ms/step - loss: 0.0653 - accuracy: 0.9599 - val_loss: 1.0765 - val_accuracy: 0.7940
Epoch 39/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0491 - accuracy: 0.9720
 6/16 [==========>...................] - ETA: 0s - loss: 0.0524 - accuracy: 0.9713
11/16 [===================>..........] - ETA: 0s - loss: 0.0575 - accuracy: 0.9665
15/16 [===========================>..] - ETA: 0s - loss: 0.0623 - accuracy: 0.9624
16/16 [==============================] - 0s 12ms/step - loss: 0.0629 - accuracy: 0.9622

16/16 [==============================] - 0s 21ms/step - loss: 0.0629 - accuracy: 0.9622 - val_loss: 1.0811 - val_accuracy: 0.7950
Epoch 40/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0784 - accuracy: 0.9580
 5/16 [========>.....................] - ETA: 0s - loss: 0.0538 - accuracy: 0.9704
10/16 [=================>............] - ETA: 0s - loss: 0.0587 - accuracy: 0.9658
14/16 [=========================>....] - ETA: 0s - loss: 0.0593 - accuracy: 0.9643
16/16 [==============================] - 0s 12ms/step - loss: 0.0634 - accuracy: 0.9614

16/16 [==============================] - 0s 21ms/step - loss: 0.0634 - accuracy: 0.9614 - val_loss: 1.0853 - val_accuracy: 0.7940
Epoch 41/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0448 - accuracy: 0.9720
 6/16 [==========>...................] - ETA: 0s - loss: 0.0528 - accuracy: 0.9723
11/16 [===================>..........] - ETA: 0s - loss: 0.0592 - accuracy: 0.9660
16/16 [==============================] - 0s 12ms/step - loss: 0.0625 - accuracy: 0.9623

16/16 [==============================] - 0s 21ms/step - loss: 0.0625 - accuracy: 0.9623 - val_loss: 1.0982 - val_accuracy: 0.7920
Epoch 42/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0540 - accuracy: 0.9720
 5/16 [========>.....................] - ETA: 0s - loss: 0.0591 - accuracy: 0.9664
 9/16 [===============>..............] - ETA: 0s - loss: 0.0614 - accuracy: 0.9624
14/16 [=========================>....] - ETA: 0s - loss: 0.0627 - accuracy: 0.9614
16/16 [==============================] - 0s 12ms/step - loss: 0.0623 - accuracy: 0.9609

16/16 [==============================] - 0s 21ms/step - loss: 0.0623 - accuracy: 0.9609 - val_loss: 1.0970 - val_accuracy: 0.7890
Epoch 43/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0411 - accuracy: 0.9780
 5/16 [========>.....................] - ETA: 0s - loss: 0.0476 - accuracy: 0.9768
10/16 [=================>............] - ETA: 0s - loss: 0.0553 - accuracy: 0.9682
15/16 [===========================>..] - ETA: 0s - loss: 0.0610 - accuracy: 0.9629
16/16 [==============================] - 0s 12ms/step - loss: 0.0622 - accuracy: 0.9619

16/16 [==============================] - 0s 21ms/step - loss: 0.0622 - accuracy: 0.9619 - val_loss: 1.1002 - val_accuracy: 0.7950
Epoch 44/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0310 - accuracy: 0.9840
 5/16 [========>.....................] - ETA: 0s - loss: 0.0561 - accuracy: 0.9688
10/16 [=================>............] - ETA: 0s - loss: 0.0601 - accuracy: 0.9632
14/16 [=========================>....] - ETA: 0s - loss: 0.0584 - accuracy: 0.9637
16/16 [==============================] - 0s 12ms/step - loss: 0.0607 - accuracy: 0.9614

16/16 [==============================] - 0s 21ms/step - loss: 0.0607 - accuracy: 0.9614 - val_loss: 1.1027 - val_accuracy: 0.7970
Epoch 45/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0537 - accuracy: 0.9820
 5/16 [========>.....................] - ETA: 0s - loss: 0.0502 - accuracy: 0.9752
10/16 [=================>............] - ETA: 0s - loss: 0.0556 - accuracy: 0.9684
15/16 [===========================>..] - ETA: 0s - loss: 0.0597 - accuracy: 0.9628
16/16 [==============================] - 0s 12ms/step - loss: 0.0604 - accuracy: 0.9623

16/16 [==============================] - 0s 21ms/step - loss: 0.0604 - accuracy: 0.9623 - val_loss: 1.1026 - val_accuracy: 0.7900
Epoch 46/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0539 - accuracy: 0.9680
 6/16 [==========>...................] - ETA: 0s - loss: 0.0536 - accuracy: 0.9710
10/16 [=================>............] - ETA: 0s - loss: 0.0554 - accuracy: 0.9678
15/16 [===========================>..] - ETA: 0s - loss: 0.0599 - accuracy: 0.9635
16/16 [==============================] - 0s 12ms/step - loss: 0.0609 - accuracy: 0.9624

16/16 [==============================] - 0s 21ms/step - loss: 0.0609 - accuracy: 0.9624 - val_loss: 1.1130 - val_accuracy: 0.7910
Epoch 47/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0529 - accuracy: 0.9680
 5/16 [========>.....................] - ETA: 0s - loss: 0.0485 - accuracy: 0.9744
10/16 [=================>............] - ETA: 0s - loss: 0.0537 - accuracy: 0.9694
15/16 [===========================>..] - ETA: 0s - loss: 0.0584 - accuracy: 0.9637
16/16 [==============================] - 0s 12ms/step - loss: 0.0597 - accuracy: 0.9627

16/16 [==============================] - 0s 21ms/step - loss: 0.0597 - accuracy: 0.9627 - val_loss: 1.1218 - val_accuracy: 0.7930
Epoch 48/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0467 - accuracy: 0.9700
 6/16 [==========>...................] - ETA: 0s - loss: 0.0534 - accuracy: 0.9690
11/16 [===================>..........] - ETA: 0s - loss: 0.0555 - accuracy: 0.9662
15/16 [===========================>..] - ETA: 0s - loss: 0.0592 - accuracy: 0.9621
16/16 [==============================] - 0s 12ms/step - loss: 0.0598 - accuracy: 0.9620

16/16 [==============================] - 0s 21ms/step - loss: 0.0598 - accuracy: 0.9620 - val_loss: 1.1184 - val_accuracy: 0.7950
Epoch 49/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0425 - accuracy: 0.9820
 5/16 [========>.....................] - ETA: 0s - loss: 0.0523 - accuracy: 0.9688
10/16 [=================>............] - ETA: 0s - loss: 0.0574 - accuracy: 0.9638
15/16 [===========================>..] - ETA: 0s - loss: 0.0592 - accuracy: 0.9608
16/16 [==============================] - 0s 12ms/step - loss: 0.0588 - accuracy: 0.9610

16/16 [==============================] - 0s 21ms/step - loss: 0.0588 - accuracy: 0.9610 - val_loss: 1.1223 - val_accuracy: 0.7930
Epoch 50/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0543 - accuracy: 0.9660
 6/16 [==========>...................] - ETA: 0s - loss: 0.0484 - accuracy: 0.9710
10/16 [=================>............] - ETA: 0s - loss: 0.0526 - accuracy: 0.9678
14/16 [=========================>....] - ETA: 0s - loss: 0.0555 - accuracy: 0.9647
16/16 [==============================] - 0s 12ms/step - loss: 0.0600 - accuracy: 0.9613

16/16 [==============================] - 0s 21ms/step - loss: 0.0600 - accuracy: 0.9613 - val_loss: 1.1259 - val_accuracy: 0.7950
Epoch 51/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0515 - accuracy: 0.9700
 5/16 [========>.....................] - ETA: 0s - loss: 0.0578 - accuracy: 0.9656
 9/16 [===============>..............] - ETA: 0s - loss: 0.0547 - accuracy: 0.9664
14/16 [=========================>....] - ETA: 0s - loss: 0.0584 - accuracy: 0.9620
16/16 [==============================] - 0s 12ms/step - loss: 0.0587 - accuracy: 0.9610

16/16 [==============================] - 0s 21ms/step - loss: 0.0587 - accuracy: 0.9610 - val_loss: 1.1309 - val_accuracy: 0.7890
Epoch 52/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0579 - accuracy: 0.9680
 6/16 [==========>...................] - ETA: 0s - loss: 0.0566 - accuracy: 0.9667
10/16 [=================>............] - ETA: 0s - loss: 0.0553 - accuracy: 0.9656
14/16 [=========================>....] - ETA: 0s - loss: 0.0572 - accuracy: 0.9637
16/16 [==============================] - 0s 12ms/step - loss: 0.0596 - accuracy: 0.9612

16/16 [==============================] - 0s 21ms/step - loss: 0.0596 - accuracy: 0.9612 - val_loss: 1.1278 - val_accuracy: 0.7920
Epoch 53/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0483 - accuracy: 0.9760
 6/16 [==========>...................] - ETA: 0s - loss: 0.0523 - accuracy: 0.9707
10/16 [=================>............] - ETA: 0s - loss: 0.0548 - accuracy: 0.9682
15/16 [===========================>..] - ETA: 0s - loss: 0.0576 - accuracy: 0.9632
16/16 [==============================] - 0s 12ms/step - loss: 0.0582 - accuracy: 0.9629

16/16 [==============================] - 0s 21ms/step - loss: 0.0582 - accuracy: 0.9629 - val_loss: 1.1471 - val_accuracy: 0.7880
Epoch 54/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0624 - accuracy: 0.9580
 5/16 [========>.....................] - ETA: 0s - loss: 0.0574 - accuracy: 0.9624
 9/16 [===============>..............] - ETA: 0s - loss: 0.0556 - accuracy: 0.9627
13/16 [=======================>......] - ETA: 0s - loss: 0.0567 - accuracy: 0.9617
16/16 [==============================] - 0s 12ms/step - loss: 0.0588 - accuracy: 0.9597

16/16 [==============================] - 0s 21ms/step - loss: 0.0588 - accuracy: 0.9597 - val_loss: 1.1375 - val_accuracy: 0.7920
Epoch 55/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0440 - accuracy: 0.9680
 5/16 [========>.....................] - ETA: 0s - loss: 0.0464 - accuracy: 0.9704
 9/16 [===============>..............] - ETA: 0s - loss: 0.0503 - accuracy: 0.9676
14/16 [=========================>....] - ETA: 0s - loss: 0.0549 - accuracy: 0.9624
16/16 [==============================] - 0s 12ms/step - loss: 0.0580 - accuracy: 0.9599

16/16 [==============================] - 0s 22ms/step - loss: 0.0580 - accuracy: 0.9599 - val_loss: 1.1469 - val_accuracy: 0.7900
Epoch 56/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0316 - accuracy: 0.9820
 5/16 [========>.....................] - ETA: 0s - loss: 0.0459 - accuracy: 0.9752
 9/16 [===============>..............] - ETA: 0s - loss: 0.0482 - accuracy: 0.9720
13/16 [=======================>......] - ETA: 0s - loss: 0.0529 - accuracy: 0.9658
16/16 [==============================] - 0s 12ms/step - loss: 0.0573 - accuracy: 0.9617

16/16 [==============================] - 0s 21ms/step - loss: 0.0573 - accuracy: 0.9617 - val_loss: 1.1444 - val_accuracy: 0.7930
Epoch 57/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0515 - accuracy: 0.9720
 6/16 [==========>...................] - ETA: 0s - loss: 0.0487 - accuracy: 0.9687
10/16 [=================>............] - ETA: 0s - loss: 0.0500 - accuracy: 0.9668
14/16 [=========================>....] - ETA: 0s - loss: 0.0539 - accuracy: 0.9636
16/16 [==============================] - 0s 12ms/step - loss: 0.0577 - accuracy: 0.9605

16/16 [==============================] - 0s 21ms/step - loss: 0.0577 - accuracy: 0.9605 - val_loss: 1.1417 - val_accuracy: 0.7920
Epoch 58/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0482 - accuracy: 0.9760
 6/16 [==========>...................] - ETA: 0s - loss: 0.0545 - accuracy: 0.9663
10/16 [=================>............] - ETA: 0s - loss: 0.0551 - accuracy: 0.9662
14/16 [=========================>....] - ETA: 0s - loss: 0.0570 - accuracy: 0.9633
16/16 [==============================] - 0s 12ms/step - loss: 0.0575 - accuracy: 0.9625

16/16 [==============================] - 0s 21ms/step - loss: 0.0575 - accuracy: 0.9625 - val_loss: 1.1610 - val_accuracy: 0.7940
Epoch 59/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0514 - accuracy: 0.9740
 5/16 [========>.....................] - ETA: 0s - loss: 0.0563 - accuracy: 0.9672
 9/16 [===============>..............] - ETA: 0s - loss: 0.0538 - accuracy: 0.9669
13/16 [=======================>......] - ETA: 0s - loss: 0.0551 - accuracy: 0.9646
16/16 [==============================] - 0s 12ms/step - loss: 0.0576 - accuracy: 0.9623

16/16 [==============================] - 0s 22ms/step - loss: 0.0576 - accuracy: 0.9623 - val_loss: 1.1530 - val_accuracy: 0.7890
Epoch 60/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0375 - accuracy: 0.9820
 6/16 [==========>...................] - ETA: 0s - loss: 0.0478 - accuracy: 0.9710
11/16 [===================>..........] - ETA: 0s - loss: 0.0555 - accuracy: 0.9636
16/16 [==============================] - 0s 11ms/step - loss: 0.0567 - accuracy: 0.9617

16/16 [==============================] - 0s 20ms/step - loss: 0.0567 - accuracy: 0.9617 - val_loss: 1.1613 - val_accuracy: 0.7900
Epoch 61/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0546 - accuracy: 0.9700
 5/16 [========>.....................] - ETA: 0s - loss: 0.0585 - accuracy: 0.9648
 9/16 [===============>..............] - ETA: 0s - loss: 0.0565 - accuracy: 0.9627
14/16 [=========================>....] - ETA: 0s - loss: 0.0542 - accuracy: 0.9631
16/16 [==============================] - 0s 12ms/step - loss: 0.0564 - accuracy: 0.9609

16/16 [==============================] - 0s 21ms/step - loss: 0.0564 - accuracy: 0.9609 - val_loss: 1.1565 - val_accuracy: 0.7930
Epoch 62/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0533 - accuracy: 0.9700
 5/16 [========>.....................] - ETA: 0s - loss: 0.0538 - accuracy: 0.9652
10/16 [=================>............] - ETA: 0s - loss: 0.0513 - accuracy: 0.9678
15/16 [===========================>..] - ETA: 0s - loss: 0.0550 - accuracy: 0.9629
16/16 [==============================] - 0s 11ms/step - loss: 0.0557 - accuracy: 0.9622

16/16 [==============================] - 0s 21ms/step - loss: 0.0557 - accuracy: 0.9622 - val_loss: 1.1692 - val_accuracy: 0.7870
Epoch 63/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0554 - accuracy: 0.9660
 5/16 [========>.....................] - ETA: 0s - loss: 0.0550 - accuracy: 0.9688
 9/16 [===============>..............] - ETA: 0s - loss: 0.0508 - accuracy: 0.9700
13/16 [=======================>......] - ETA: 0s - loss: 0.0546 - accuracy: 0.9655
16/16 [==============================] - 0s 12ms/step - loss: 0.0563 - accuracy: 0.9630

16/16 [==============================] - 0s 21ms/step - loss: 0.0563 - accuracy: 0.9630 - val_loss: 1.1708 - val_accuracy: 0.7930
Epoch 64/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0557 - accuracy: 0.9640
 5/16 [========>.....................] - ETA: 0s - loss: 0.0489 - accuracy: 0.9708
10/16 [=================>............] - ETA: 0s - loss: 0.0523 - accuracy: 0.9676
15/16 [===========================>..] - ETA: 0s - loss: 0.0547 - accuracy: 0.9643
16/16 [==============================] - 0s 11ms/step - loss: 0.0559 - accuracy: 0.9625

16/16 [==============================] - 0s 21ms/step - loss: 0.0559 - accuracy: 0.9625 - val_loss: 1.1759 - val_accuracy: 0.7910
Epoch 65/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0547 - accuracy: 0.9620
 6/16 [==========>...................] - ETA: 0s - loss: 0.0576 - accuracy: 0.9630
11/16 [===================>..........] - ETA: 0s - loss: 0.0551 - accuracy: 0.9642
16/16 [==============================] - 0s 12ms/step - loss: 0.0560 - accuracy: 0.9618

16/16 [==============================] - 0s 21ms/step - loss: 0.0560 - accuracy: 0.9618 - val_loss: 1.1737 - val_accuracy: 0.7920
Epoch 66/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0460 - accuracy: 0.9740
 5/16 [========>.....................] - ETA: 0s - loss: 0.0484 - accuracy: 0.9728
 9/16 [===============>..............] - ETA: 0s - loss: 0.0497 - accuracy: 0.9696
14/16 [=========================>....] - ETA: 0s - loss: 0.0540 - accuracy: 0.9639
16/16 [==============================] - 0s 12ms/step - loss: 0.0552 - accuracy: 0.9619

16/16 [==============================] - 0s 21ms/step - loss: 0.0552 - accuracy: 0.9619 - val_loss: 1.1789 - val_accuracy: 0.7900
Epoch 67/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0666 - accuracy: 0.9600
 5/16 [========>.....................] - ETA: 0s - loss: 0.0519 - accuracy: 0.9692
 9/16 [===============>..............] - ETA: 0s - loss: 0.0514 - accuracy: 0.9676
13/16 [=======================>......] - ETA: 0s - loss: 0.0533 - accuracy: 0.9646
16/16 [==============================] - 0s 12ms/step - loss: 0.0548 - accuracy: 0.9624

16/16 [==============================] - 0s 21ms/step - loss: 0.0548 - accuracy: 0.9624 - val_loss: 1.1742 - val_accuracy: 0.7890
Epoch 68/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0519 - accuracy: 0.9660
 6/16 [==========>...................] - ETA: 0s - loss: 0.0449 - accuracy: 0.9697
11/16 [===================>..........] - ETA: 0s - loss: 0.0522 - accuracy: 0.9636
16/16 [==============================] - 0s 11ms/step - loss: 0.0553 - accuracy: 0.9604

16/16 [==============================] - 0s 20ms/step - loss: 0.0553 - accuracy: 0.9604 - val_loss: 1.1850 - val_accuracy: 0.7900
Epoch 69/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0387 - accuracy: 0.9800
 6/16 [==========>...................] - ETA: 0s - loss: 0.0462 - accuracy: 0.9717
11/16 [===================>..........] - ETA: 0s - loss: 0.0495 - accuracy: 0.9685
16/16 [==============================] - 0s 11ms/step - loss: 0.0546 - accuracy: 0.9619

16/16 [==============================] - 0s 21ms/step - loss: 0.0546 - accuracy: 0.9619 - val_loss: 1.1881 - val_accuracy: 0.7890
Epoch 70/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0477 - accuracy: 0.9760
 5/16 [========>.....................] - ETA: 0s - loss: 0.0522 - accuracy: 0.9680
 9/16 [===============>..............] - ETA: 0s - loss: 0.0532 - accuracy: 0.9636
13/16 [=======================>......] - ETA: 0s - loss: 0.0531 - accuracy: 0.9622
16/16 [==============================] - 0s 12ms/step - loss: 0.0552 - accuracy: 0.9597

16/16 [==============================] - 0s 21ms/step - loss: 0.0552 - accuracy: 0.9597 - val_loss: 1.1988 - val_accuracy: 0.7900
Epoch 71/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0414 - accuracy: 0.9800
 5/16 [========>.....................] - ETA: 0s - loss: 0.0500 - accuracy: 0.9708
10/16 [=================>............] - ETA: 0s - loss: 0.0516 - accuracy: 0.9662
15/16 [===========================>..] - ETA: 0s - loss: 0.0550 - accuracy: 0.9613
16/16 [==============================] - 0s 12ms/step - loss: 0.0539 - accuracy: 0.9623

16/16 [==============================] - 0s 21ms/step - loss: 0.0539 - accuracy: 0.9623 - val_loss: 1.1834 - val_accuracy: 0.7930
Epoch 72/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0610 - accuracy: 0.9660
 5/16 [========>.....................] - ETA: 0s - loss: 0.0549 - accuracy: 0.9656
10/16 [=================>............] - ETA: 0s - loss: 0.0516 - accuracy: 0.9660
15/16 [===========================>..] - ETA: 0s - loss: 0.0531 - accuracy: 0.9625
16/16 [==============================] - 0s 12ms/step - loss: 0.0536 - accuracy: 0.9617

16/16 [==============================] - 0s 21ms/step - loss: 0.0536 - accuracy: 0.9617 - val_loss: 1.1943 - val_accuracy: 0.7900
Epoch 73/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0505 - accuracy: 0.9660
 5/16 [========>.....................] - ETA: 0s - loss: 0.0506 - accuracy: 0.9668
 9/16 [===============>..............] - ETA: 0s - loss: 0.0489 - accuracy: 0.9662
14/16 [=========================>....] - ETA: 0s - loss: 0.0530 - accuracy: 0.9627
16/16 [==============================] - 0s 12ms/step - loss: 0.0539 - accuracy: 0.9609

16/16 [==============================] - 0s 21ms/step - loss: 0.0539 - accuracy: 0.9609 - val_loss: 1.2038 - val_accuracy: 0.7930
Epoch 74/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0465 - accuracy: 0.9740
 6/16 [==========>...................] - ETA: 0s - loss: 0.0519 - accuracy: 0.9673
11/16 [===================>..........] - ETA: 0s - loss: 0.0509 - accuracy: 0.9673
16/16 [==============================] - 0s 12ms/step - loss: 0.0548 - accuracy: 0.9627

16/16 [==============================] - 0s 21ms/step - loss: 0.0548 - accuracy: 0.9627 - val_loss: 1.1925 - val_accuracy: 0.7930
Epoch 75/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0461 - accuracy: 0.9800
 5/16 [========>.....................] - ETA: 0s - loss: 0.0494 - accuracy: 0.9728
10/16 [=================>............] - ETA: 0s - loss: 0.0495 - accuracy: 0.9700
14/16 [=========================>....] - ETA: 0s - loss: 0.0523 - accuracy: 0.9663
16/16 [==============================] - 0s 12ms/step - loss: 0.0541 - accuracy: 0.9638

16/16 [==============================] - 0s 21ms/step - loss: 0.0541 - accuracy: 0.9638 - val_loss: 1.2029 - val_accuracy: 0.7900
Epoch 76/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0378 - accuracy: 0.9800
 6/16 [==========>...................] - ETA: 0s - loss: 0.0480 - accuracy: 0.9707
11/16 [===================>..........] - ETA: 0s - loss: 0.0499 - accuracy: 0.9667
16/16 [==============================] - 0s 11ms/step - loss: 0.0533 - accuracy: 0.9627

16/16 [==============================] - 0s 21ms/step - loss: 0.0533 - accuracy: 0.9627 - val_loss: 1.2091 - val_accuracy: 0.7880
Epoch 77/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0393 - accuracy: 0.9720
 6/16 [==========>...................] - ETA: 0s - loss: 0.0481 - accuracy: 0.9680
11/16 [===================>..........] - ETA: 0s - loss: 0.0519 - accuracy: 0.9625
15/16 [===========================>..] - ETA: 0s - loss: 0.0543 - accuracy: 0.9593
16/16 [==============================] - 0s 12ms/step - loss: 0.0540 - accuracy: 0.9593

16/16 [==============================] - 0s 21ms/step - loss: 0.0540 - accuracy: 0.9593 - val_loss: 1.2122 - val_accuracy: 0.7900
Epoch 78/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0415 - accuracy: 0.9720
 5/16 [========>.....................] - ETA: 0s - loss: 0.0448 - accuracy: 0.9724
 9/16 [===============>..............] - ETA: 0s - loss: 0.0501 - accuracy: 0.9671
13/16 [=======================>......] - ETA: 0s - loss: 0.0516 - accuracy: 0.9635
16/16 [==============================] - 0s 12ms/step - loss: 0.0530 - accuracy: 0.9610

16/16 [==============================] - 0s 21ms/step - loss: 0.0530 - accuracy: 0.9610 - val_loss: 1.2089 - val_accuracy: 0.7900
Epoch 79/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0256 - accuracy: 0.9880
 5/16 [========>.....................] - ETA: 0s - loss: 0.0444 - accuracy: 0.9712
 9/16 [===============>..............] - ETA: 0s - loss: 0.0478 - accuracy: 0.9689
13/16 [=======================>......] - ETA: 0s - loss: 0.0497 - accuracy: 0.9654
16/16 [==============================] - 0s 12ms/step - loss: 0.0532 - accuracy: 0.9618

16/16 [==============================] - 0s 22ms/step - loss: 0.0532 - accuracy: 0.9618 - val_loss: 1.2134 - val_accuracy: 0.7900
Epoch 80/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0505 - accuracy: 0.9720
 5/16 [========>.....................] - ETA: 0s - loss: 0.0511 - accuracy: 0.9656
 9/16 [===============>..............] - ETA: 0s - loss: 0.0500 - accuracy: 0.9664
13/16 [=======================>......] - ETA: 0s - loss: 0.0518 - accuracy: 0.9640
16/16 [==============================] - 0s 12ms/step - loss: 0.0530 - accuracy: 0.9624

16/16 [==============================] - 0s 21ms/step - loss: 0.0530 - accuracy: 0.9624 - val_loss: 1.2095 - val_accuracy: 0.7940
Epoch 81/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0434 - accuracy: 0.9720
 6/16 [==========>...................] - ETA: 0s - loss: 0.0460 - accuracy: 0.9710
11/16 [===================>..........] - ETA: 0s - loss: 0.0500 - accuracy: 0.9653
15/16 [===========================>..] - ETA: 0s - loss: 0.0518 - accuracy: 0.9625
16/16 [==============================] - 0s 12ms/step - loss: 0.0529 - accuracy: 0.9617

16/16 [==============================] - 0s 21ms/step - loss: 0.0529 - accuracy: 0.9617 - val_loss: 1.2298 - val_accuracy: 0.7920
Epoch 82/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0498 - accuracy: 0.9660
 6/16 [==========>...................] - ETA: 0s - loss: 0.0458 - accuracy: 0.9700
11/16 [===================>..........] - ETA: 0s - loss: 0.0505 - accuracy: 0.9642
16/16 [==============================] - 0s 11ms/step - loss: 0.0523 - accuracy: 0.9619

16/16 [==============================] - 0s 21ms/step - loss: 0.0523 - accuracy: 0.9619 - val_loss: 1.2290 - val_accuracy: 0.7930
Epoch 83/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0461 - accuracy: 0.9700
 6/16 [==========>...................] - ETA: 0s - loss: 0.0488 - accuracy: 0.9657
10/16 [=================>............] - ETA: 0s - loss: 0.0494 - accuracy: 0.9648
15/16 [===========================>..] - ETA: 0s - loss: 0.0522 - accuracy: 0.9612
16/16 [==============================] - 0s 12ms/step - loss: 0.0523 - accuracy: 0.9608

16/16 [==============================] - 0s 21ms/step - loss: 0.0523 - accuracy: 0.9608 - val_loss: 1.2259 - val_accuracy: 0.7910
Epoch 84/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0490 - accuracy: 0.9700
 6/16 [==========>...................] - ETA: 0s - loss: 0.0486 - accuracy: 0.9677
10/16 [=================>............] - ETA: 0s - loss: 0.0491 - accuracy: 0.9666
14/16 [=========================>....] - ETA: 0s - loss: 0.0512 - accuracy: 0.9633
16/16 [==============================] - 0s 12ms/step - loss: 0.0526 - accuracy: 0.9614

16/16 [==============================] - 0s 21ms/step - loss: 0.0526 - accuracy: 0.9614 - val_loss: 1.2270 - val_accuracy: 0.7890
Epoch 85/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0444 - accuracy: 0.9800
 5/16 [========>.....................] - ETA: 0s - loss: 0.0480 - accuracy: 0.9696
 9/16 [===============>..............] - ETA: 0s - loss: 0.0507 - accuracy: 0.9656
13/16 [=======================>......] - ETA: 0s - loss: 0.0525 - accuracy: 0.9631
16/16 [==============================] - 0s 12ms/step - loss: 0.0534 - accuracy: 0.9619

16/16 [==============================] - 0s 22ms/step - loss: 0.0534 - accuracy: 0.9619 - val_loss: 1.2242 - val_accuracy: 0.7930
Epoch 86/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0445 - accuracy: 0.9740
 6/16 [==========>...................] - ETA: 0s - loss: 0.0515 - accuracy: 0.9660
10/16 [=================>............] - ETA: 0s - loss: 0.0502 - accuracy: 0.9656
14/16 [=========================>....] - ETA: 0s - loss: 0.0516 - accuracy: 0.9641
16/16 [==============================] - 0s 12ms/step - loss: 0.0533 - accuracy: 0.9624

16/16 [==============================] - 0s 21ms/step - loss: 0.0533 - accuracy: 0.9624 - val_loss: 1.2303 - val_accuracy: 0.7890
Epoch 87/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0561 - accuracy: 0.9560
 6/16 [==========>...................] - ETA: 0s - loss: 0.0499 - accuracy: 0.9677
11/16 [===================>..........] - ETA: 0s - loss: 0.0490 - accuracy: 0.9660
15/16 [===========================>..] - ETA: 0s - loss: 0.0523 - accuracy: 0.9625
16/16 [==============================] - 0s 12ms/step - loss: 0.0525 - accuracy: 0.9618

16/16 [==============================] - 0s 21ms/step - loss: 0.0525 - accuracy: 0.9618 - val_loss: 1.2369 - val_accuracy: 0.7900
Epoch 88/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0399 - accuracy: 0.9800
 5/16 [========>.....................] - ETA: 0s - loss: 0.0467 - accuracy: 0.9728
 9/16 [===============>..............] - ETA: 0s - loss: 0.0477 - accuracy: 0.9693
13/16 [=======================>......] - ETA: 0s - loss: 0.0516 - accuracy: 0.9645
16/16 [==============================] - 0s 12ms/step - loss: 0.0521 - accuracy: 0.9630

16/16 [==============================] - 0s 21ms/step - loss: 0.0521 - accuracy: 0.9630 - val_loss: 1.2396 - val_accuracy: 0.7940
Epoch 89/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0551 - accuracy: 0.9640
 5/16 [========>.....................] - ETA: 0s - loss: 0.0536 - accuracy: 0.9660
 9/16 [===============>..............] - ETA: 0s - loss: 0.0510 - accuracy: 0.9642
13/16 [=======================>......] - ETA: 0s - loss: 0.0504 - accuracy: 0.9632
16/16 [==============================] - 0s 12ms/step - loss: 0.0516 - accuracy: 0.9615

16/16 [==============================] - 0s 22ms/step - loss: 0.0516 - accuracy: 0.9615 - val_loss: 1.2345 - val_accuracy: 0.7910
Epoch 90/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0699 - accuracy: 0.9580
 6/16 [==========>...................] - ETA: 0s - loss: 0.0507 - accuracy: 0.9677
11/16 [===================>..........] - ETA: 0s - loss: 0.0514 - accuracy: 0.9653
16/16 [==============================] - 0s 11ms/step - loss: 0.0521 - accuracy: 0.9633

16/16 [==============================] - 0s 20ms/step - loss: 0.0521 - accuracy: 0.9633 - val_loss: 1.2388 - val_accuracy: 0.7900
Epoch 91/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0616 - accuracy: 0.9620
 5/16 [========>.....................] - ETA: 0s - loss: 0.0496 - accuracy: 0.9688
10/16 [=================>............] - ETA: 0s - loss: 0.0541 - accuracy: 0.9642
14/16 [=========================>....] - ETA: 0s - loss: 0.0525 - accuracy: 0.9637
16/16 [==============================] - 0s 12ms/step - loss: 0.0523 - accuracy: 0.9630

16/16 [==============================] - 0s 21ms/step - loss: 0.0523 - accuracy: 0.9630 - val_loss: 1.2431 - val_accuracy: 0.7900
Epoch 92/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0567 - accuracy: 0.9760
 5/16 [========>.....................] - ETA: 0s - loss: 0.0510 - accuracy: 0.9676
 9/16 [===============>..............] - ETA: 0s - loss: 0.0506 - accuracy: 0.9669
13/16 [=======================>......] - ETA: 0s - loss: 0.0522 - accuracy: 0.9643
16/16 [==============================] - 0s 13ms/step - loss: 0.0523 - accuracy: 0.9630

16/16 [==============================] - 0s 22ms/step - loss: 0.0523 - accuracy: 0.9630 - val_loss: 1.2376 - val_accuracy: 0.7940
Epoch 93/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0505 - accuracy: 0.9680
 5/16 [========>.....................] - ETA: 0s - loss: 0.0459 - accuracy: 0.9708
10/16 [=================>............] - ETA: 0s - loss: 0.0507 - accuracy: 0.9660
14/16 [=========================>....] - ETA: 0s - loss: 0.0518 - accuracy: 0.9641
16/16 [==============================] - 0s 12ms/step - loss: 0.0516 - accuracy: 0.9633

16/16 [==============================] - 0s 22ms/step - loss: 0.0516 - accuracy: 0.9633 - val_loss: 1.2485 - val_accuracy: 0.7890
Epoch 94/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0386 - accuracy: 0.9700
 5/16 [========>.....................] - ETA: 0s - loss: 0.0426 - accuracy: 0.9720
10/16 [=================>............] - ETA: 0s - loss: 0.0505 - accuracy: 0.9666
14/16 [=========================>....] - ETA: 0s - loss: 0.0510 - accuracy: 0.9647
16/16 [==============================] - 0s 12ms/step - loss: 0.0514 - accuracy: 0.9640

16/16 [==============================] - 0s 21ms/step - loss: 0.0514 - accuracy: 0.9640 - val_loss: 1.2513 - val_accuracy: 0.7910
Epoch 95/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0521 - accuracy: 0.9680
 6/16 [==========>...................] - ETA: 0s - loss: 0.0515 - accuracy: 0.9667
11/16 [===================>..........] - ETA: 0s - loss: 0.0522 - accuracy: 0.9645
15/16 [===========================>..] - ETA: 0s - loss: 0.0518 - accuracy: 0.9632
16/16 [==============================] - 0s 12ms/step - loss: 0.0518 - accuracy: 0.9630

16/16 [==============================] - 0s 21ms/step - loss: 0.0518 - accuracy: 0.9630 - val_loss: 1.2567 - val_accuracy: 0.7910
Epoch 96/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0568 - accuracy: 0.9620
 5/16 [========>.....................] - ETA: 0s - loss: 0.0498 - accuracy: 0.9664
 9/16 [===============>..............] - ETA: 0s - loss: 0.0483 - accuracy: 0.9662
13/16 [=======================>......] - ETA: 0s - loss: 0.0510 - accuracy: 0.9626
16/16 [==============================] - 0s 12ms/step - loss: 0.0509 - accuracy: 0.9617

16/16 [==============================] - 0s 21ms/step - loss: 0.0509 - accuracy: 0.9617 - val_loss: 1.2503 - val_accuracy: 0.7910
Epoch 97/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0549 - accuracy: 0.9660
 5/16 [========>.....................] - ETA: 0s - loss: 0.0514 - accuracy: 0.9676
 9/16 [===============>..............] - ETA: 0s - loss: 0.0499 - accuracy: 0.9660
13/16 [=======================>......] - ETA: 0s - loss: 0.0499 - accuracy: 0.9652
16/16 [==============================] - 0s 12ms/step - loss: 0.0511 - accuracy: 0.9620

16/16 [==============================] - 0s 21ms/step - loss: 0.0511 - accuracy: 0.9620 - val_loss: 1.2533 - val_accuracy: 0.7910
Epoch 98/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0490 - accuracy: 0.9700
 5/16 [========>.....................] - ETA: 0s - loss: 0.0514 - accuracy: 0.9684
10/16 [=================>............] - ETA: 0s - loss: 0.0513 - accuracy: 0.9650
14/16 [=========================>....] - ETA: 0s - loss: 0.0494 - accuracy: 0.9654
16/16 [==============================] - 0s 12ms/step - loss: 0.0511 - accuracy: 0.9633

16/16 [==============================] - 0s 21ms/step - loss: 0.0511 - accuracy: 0.9633 - val_loss: 1.2674 - val_accuracy: 0.7900
Epoch 99/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0418 - accuracy: 0.9720
 5/16 [========>.....................] - ETA: 0s - loss: 0.0438 - accuracy: 0.9728
 9/16 [===============>..............] - ETA: 0s - loss: 0.0493 - accuracy: 0.9667
13/16 [=======================>......] - ETA: 0s - loss: 0.0517 - accuracy: 0.9626
16/16 [==============================] - 0s 13ms/step - loss: 0.0512 - accuracy: 0.9617

16/16 [==============================] - 0s 22ms/step - loss: 0.0512 - accuracy: 0.9617 - val_loss: 1.2655 - val_accuracy: 0.7920
Epoch 100/100

 1/16 [>.............................] - ETA: 0s - loss: 0.0394 - accuracy: 0.9820
 6/16 [==========>...................] - ETA: 0s - loss: 0.0456 - accuracy: 0.9737
11/16 [===================>..........] - ETA: 0s - loss: 0.0488 - accuracy: 0.9673
16/16 [==============================] - 0s 11ms/step - loss: 0.0512 - accuracy: 0.9629

16/16 [==============================] - 0s 21ms/step - loss: 0.0512 - accuracy: 0.9629 - val_loss: 1.2643 - val_accuracy: 0.7910

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-01T18-47-32Z

Training run 2/8 (flags = list(128, 1e-04, 500, 30, "sigmoid")) 
Using run directory runs/2020-11-01T18-48-09Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = 10000) %>%
+         layer_dense( units = FLAGS$n .... [TRUNCATED] 

> set.seed(123)

> model %>% compile (
+         loss = 'sparse_categorical_crossentropy',
+         optimizer = optimizer_adam(lr=FLAGS$learning_rate),
+         metr .... [TRUNCATED] 

> model %>% fit (x = reuters_train, y = reuters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = list(reuters_val .... [TRUNCATED] 
Epoch 1/30

 1/16 [>.............................] - ETA: 0s - loss: 4.0012 - accuracy: 0.0720
 5/16 [========>.....................] - ETA: 0s - loss: 3.9688 - accuracy: 0.0628
 8/16 [==============>...............] - ETA: 0s - loss: 3.9459 - accuracy: 0.0637
11/16 [===================>..........] - ETA: 0s - loss: 3.9223 - accuracy: 0.0616
14/16 [=========================>....] - ETA: 0s - loss: 3.8960 - accuracy: 0.0620
16/16 [==============================] - 0s 16ms/step - loss: 3.8814 - accuracy: 0.0614

16/16 [==============================] - 1s 55ms/step - loss: 3.8814 - accuracy: 0.0614 - val_loss: 3.7328 - val_accuracy: 0.0590
Epoch 2/30

 1/16 [>.............................] - ETA: 0s - loss: 3.7240 - accuracy: 0.0640
 4/16 [======>.......................] - ETA: 0s - loss: 3.6876 - accuracy: 0.0650
 7/16 [============>.................] - ETA: 0s - loss: 3.6691 - accuracy: 0.0637
10/16 [=================>............] - ETA: 0s - loss: 3.6475 - accuracy: 0.0644
13/16 [=======================>......] - ETA: 0s - loss: 3.6275 - accuracy: 0.0614
16/16 [==============================] - 0s 17ms/step - loss: 3.6075 - accuracy: 0.0614

16/16 [==============================] - 0s 27ms/step - loss: 3.6075 - accuracy: 0.0614 - val_loss: 3.4691 - val_accuracy: 0.0590
Epoch 3/30

 1/16 [>.............................] - ETA: 0s - loss: 3.4532 - accuracy: 0.0540
 4/16 [======>.......................] - ETA: 0s - loss: 3.4293 - accuracy: 0.0655
 8/16 [==============>...............] - ETA: 0s - loss: 3.4083 - accuracy: 0.0613
12/16 [=====================>........] - ETA: 0s - loss: 3.3805 - accuracy: 0.0622
16/16 [==============================] - 0s 16ms/step - loss: 3.3562 - accuracy: 0.0614

16/16 [==============================] - 0s 26ms/step - loss: 3.3562 - accuracy: 0.0614 - val_loss: 3.2299 - val_accuracy: 0.0590
Epoch 4/30

 1/16 [>.............................] - ETA: 0s - loss: 3.1776 - accuracy: 0.0680
 4/16 [======>.......................] - ETA: 0s - loss: 3.2073 - accuracy: 0.0690
 7/16 [============>.................] - ETA: 0s - loss: 3.1921 - accuracy: 0.0649
10/16 [=================>............] - ETA: 0s - loss: 3.1738 - accuracy: 0.0756
13/16 [=======================>......] - ETA: 0s - loss: 3.1521 - accuracy: 0.1408
16/16 [==============================] - 0s 17ms/step - loss: 3.1311 - accuracy: 0.1807

16/16 [==============================] - 0s 26ms/step - loss: 3.1311 - accuracy: 0.1807 - val_loss: 3.0230 - val_accuracy: 0.3540
Epoch 5/30

 1/16 [>.............................] - ETA: 0s - loss: 3.0223 - accuracy: 0.3640
 4/16 [======>.......................] - ETA: 0s - loss: 2.9938 - accuracy: 0.3535
 7/16 [============>.................] - ETA: 0s - loss: 2.9862 - accuracy: 0.3534
11/16 [===================>..........] - ETA: 0s - loss: 2.9717 - accuracy: 0.3513
15/16 [===========================>..] - ETA: 0s - loss: 2.9462 - accuracy: 0.3511
16/16 [==============================] - 0s 16ms/step - loss: 2.9425 - accuracy: 0.3514

16/16 [==============================] - 0s 25ms/step - loss: 2.9425 - accuracy: 0.3514 - val_loss: 2.8518 - val_accuracy: 0.3540
Epoch 6/30

 1/16 [>.............................] - ETA: 0s - loss: 2.9076 - accuracy: 0.3440
 4/16 [======>.......................] - ETA: 0s - loss: 2.8467 - accuracy: 0.3490
 8/16 [==============>...............] - ETA: 0s - loss: 2.8344 - accuracy: 0.3478
12/16 [=====================>........] - ETA: 0s - loss: 2.8073 - accuracy: 0.3500
15/16 [===========================>..] - ETA: 0s - loss: 2.7909 - accuracy: 0.3531
16/16 [==============================] - 0s 16ms/step - loss: 2.7909 - accuracy: 0.3514

16/16 [==============================] - 0s 26ms/step - loss: 2.7909 - accuracy: 0.3514 - val_loss: 2.7220 - val_accuracy: 0.3540
Epoch 7/30

 1/16 [>.............................] - ETA: 0s - loss: 2.6249 - accuracy: 0.3760
 4/16 [======>.......................] - ETA: 0s - loss: 2.7026 - accuracy: 0.3470
 7/16 [============>.................] - ETA: 0s - loss: 2.7180 - accuracy: 0.3440
10/16 [=================>............] - ETA: 0s - loss: 2.7174 - accuracy: 0.3450
13/16 [=======================>......] - ETA: 0s - loss: 2.7043 - accuracy: 0.3463
16/16 [==============================] - 0s 17ms/step - loss: 2.6789 - accuracy: 0.3514

16/16 [==============================] - 0s 26ms/step - loss: 2.6789 - accuracy: 0.3514 - val_loss: 2.6290 - val_accuracy: 0.3540
Epoch 8/30

 1/16 [>.............................] - ETA: 0s - loss: 2.6474 - accuracy: 0.3660
 4/16 [======>.......................] - ETA: 0s - loss: 2.6149 - accuracy: 0.3545
 7/16 [============>.................] - ETA: 0s - loss: 2.6177 - accuracy: 0.3549
10/16 [=================>............] - ETA: 0s - loss: 2.6041 - accuracy: 0.3524
13/16 [=======================>......] - ETA: 0s - loss: 2.6085 - accuracy: 0.3494
16/16 [==============================] - 0s 17ms/step - loss: 2.6002 - accuracy: 0.3514

16/16 [==============================] - 0s 27ms/step - loss: 2.6002 - accuracy: 0.3514 - val_loss: 2.5626 - val_accuracy: 0.3540
Epoch 9/30

 1/16 [>.............................] - ETA: 0s - loss: 2.6221 - accuracy: 0.3480
 4/16 [======>.......................] - ETA: 0s - loss: 2.6025 - accuracy: 0.3400
 7/16 [============>.................] - ETA: 0s - loss: 2.5810 - accuracy: 0.3483
10/16 [=================>............] - ETA: 0s - loss: 2.5810 - accuracy: 0.3410
14/16 [=========================>....] - ETA: 0s - loss: 2.5514 - accuracy: 0.3473
16/16 [==============================] - 0s 16ms/step - loss: 2.5436 - accuracy: 0.3514

16/16 [==============================] - 0s 26ms/step - loss: 2.5436 - accuracy: 0.3514 - val_loss: 2.5149 - val_accuracy: 0.3540
Epoch 10/30

 1/16 [>.............................] - ETA: 0s - loss: 2.5140 - accuracy: 0.3680
 4/16 [======>.......................] - ETA: 0s - loss: 2.5364 - accuracy: 0.3505
 7/16 [============>.................] - ETA: 0s - loss: 2.5334 - accuracy: 0.3454
11/16 [===================>..........] - ETA: 0s - loss: 2.5195 - accuracy: 0.3453
15/16 [===========================>..] - ETA: 0s - loss: 2.5003 - accuracy: 0.3512
16/16 [==============================] - 0s 15ms/step - loss: 2.5027 - accuracy: 0.3514

16/16 [==============================] - 0s 25ms/step - loss: 2.5027 - accuracy: 0.3514 - val_loss: 2.4795 - val_accuracy: 0.3540
Epoch 11/30

 1/16 [>.............................] - ETA: 0s - loss: 2.4124 - accuracy: 0.3600
 4/16 [======>.......................] - ETA: 0s - loss: 2.4732 - accuracy: 0.3425
 7/16 [============>.................] - ETA: 0s - loss: 2.4731 - accuracy: 0.3494
11/16 [===================>..........] - ETA: 0s - loss: 2.4710 - accuracy: 0.3507
15/16 [===========================>..] - ETA: 0s - loss: 2.4726 - accuracy: 0.3501
16/16 [==============================] - 0s 16ms/step - loss: 2.4716 - accuracy: 0.3514

16/16 [==============================] - 0s 25ms/step - loss: 2.4716 - accuracy: 0.3514 - val_loss: 2.4517 - val_accuracy: 0.3540
Epoch 12/30

 1/16 [>.............................] - ETA: 0s - loss: 2.5291 - accuracy: 0.3320
 4/16 [======>.......................] - ETA: 0s - loss: 2.4413 - accuracy: 0.3555
 7/16 [============>.................] - ETA: 0s - loss: 2.4688 - accuracy: 0.3506
10/16 [=================>............] - ETA: 0s - loss: 2.4659 - accuracy: 0.3488
13/16 [=======================>......] - ETA: 0s - loss: 2.4655 - accuracy: 0.3468
16/16 [==============================] - 0s 17ms/step - loss: 2.4467 - accuracy: 0.3514

16/16 [==============================] - 0s 27ms/step - loss: 2.4467 - accuracy: 0.3514 - val_loss: 2.4296 - val_accuracy: 0.3540
Epoch 13/30

 1/16 [>.............................] - ETA: 0s - loss: 2.4371 - accuracy: 0.3300
 4/16 [======>.......................] - ETA: 0s - loss: 2.4148 - accuracy: 0.3545
 7/16 [============>.................] - ETA: 0s - loss: 2.4266 - accuracy: 0.3491
10/16 [=================>............] - ETA: 0s - loss: 2.4101 - accuracy: 0.3554
13/16 [=======================>......] - ETA: 0s - loss: 2.4196 - accuracy: 0.3522
16/16 [==============================] - 0s 17ms/step - loss: 2.4265 - accuracy: 0.3514

16/16 [==============================] - 0s 26ms/step - loss: 2.4265 - accuracy: 0.3514 - val_loss: 2.4106 - val_accuracy: 0.3540
Epoch 14/30

 1/16 [>.............................] - ETA: 0s - loss: 2.4695 - accuracy: 0.3280
 4/16 [======>.......................] - ETA: 0s - loss: 2.4567 - accuracy: 0.3495
 7/16 [============>.................] - ETA: 0s - loss: 2.4415 - accuracy: 0.3474
10/16 [=================>............] - ETA: 0s - loss: 2.4209 - accuracy: 0.3494
14/16 [=========================>....] - ETA: 0s - loss: 2.3988 - accuracy: 0.3547
16/16 [==============================] - 0s 16ms/step - loss: 2.4088 - accuracy: 0.3514

16/16 [==============================] - 0s 26ms/step - loss: 2.4088 - accuracy: 0.3514 - val_loss: 2.3940 - val_accuracy: 0.3540
Epoch 15/30

 1/16 [>.............................] - ETA: 0s - loss: 2.5468 - accuracy: 0.3120
 4/16 [======>.......................] - ETA: 0s - loss: 2.4114 - accuracy: 0.3440
 7/16 [============>.................] - ETA: 0s - loss: 2.3857 - accuracy: 0.3543
11/16 [===================>..........] - ETA: 0s - loss: 2.3985 - accuracy: 0.3513
15/16 [===========================>..] - ETA: 0s - loss: 2.4004 - accuracy: 0.3496
16/16 [==============================] - 0s 17ms/step - loss: 2.3931 - accuracy: 0.3514

16/16 [==============================] - 0s 27ms/step - loss: 2.3931 - accuracy: 0.3514 - val_loss: 2.3790 - val_accuracy: 0.3540
Epoch 16/30

 1/16 [>.............................] - ETA: 0s - loss: 2.4471 - accuracy: 0.3360
 4/16 [======>.......................] - ETA: 0s - loss: 2.3986 - accuracy: 0.3455
 7/16 [============>.................] - ETA: 0s - loss: 2.3803 - accuracy: 0.3529
10/16 [=================>............] - ETA: 0s - loss: 2.3933 - accuracy: 0.3474
14/16 [=========================>....] - ETA: 0s - loss: 2.3745 - accuracy: 0.3514
16/16 [==============================] - 0s 16ms/step - loss: 2.3787 - accuracy: 0.3514

16/16 [==============================] - 0s 26ms/step - loss: 2.3787 - accuracy: 0.3514 - val_loss: 2.3650 - val_accuracy: 0.3540
Epoch 17/30

 1/16 [>.............................] - ETA: 0s - loss: 2.3153 - accuracy: 0.3300
 4/16 [======>.......................] - ETA: 0s - loss: 2.3502 - accuracy: 0.3555
 7/16 [============>.................] - ETA: 0s - loss: 2.3563 - accuracy: 0.3549
10/16 [=================>............] - ETA: 0s - loss: 2.3685 - accuracy: 0.3536
14/16 [=========================>....] - ETA: 0s - loss: 2.3680 - accuracy: 0.3529
16/16 [==============================] - 0s 16ms/step - loss: 2.3653 - accuracy: 0.3514

16/16 [==============================] - 0s 26ms/step - loss: 2.3653 - accuracy: 0.3514 - val_loss: 2.3513 - val_accuracy: 0.3540
Epoch 18/30

 1/16 [>.............................] - ETA: 0s - loss: 2.4043 - accuracy: 0.3440
 4/16 [======>.......................] - ETA: 0s - loss: 2.3625 - accuracy: 0.3485
 7/16 [============>.................] - ETA: 0s - loss: 2.3584 - accuracy: 0.3431
10/16 [=================>............] - ETA: 0s - loss: 2.3516 - accuracy: 0.3450
13/16 [=======================>......] - ETA: 0s - loss: 2.3621 - accuracy: 0.3428
16/16 [==============================] - 0s 17ms/step - loss: 2.3523 - accuracy: 0.3514

16/16 [==============================] - 0s 27ms/step - loss: 2.3523 - accuracy: 0.3514 - val_loss: 2.3383 - val_accuracy: 0.3540
Epoch 19/30

 1/16 [>.............................] - ETA: 0s - loss: 2.2787 - accuracy: 0.3600
 4/16 [======>.......................] - ETA: 0s - loss: 2.2571 - accuracy: 0.3595
 7/16 [============>.................] - ETA: 0s - loss: 2.3083 - accuracy: 0.3551
11/16 [===================>..........] - ETA: 0s - loss: 2.3549 - accuracy: 0.3473
15/16 [===========================>..] - ETA: 0s - loss: 2.3408 - accuracy: 0.3520
16/16 [==============================] - 0s 16ms/step - loss: 2.3394 - accuracy: 0.3514

16/16 [==============================] - 0s 26ms/step - loss: 2.3394 - accuracy: 0.3514 - val_loss: 2.3253 - val_accuracy: 0.3540
Epoch 20/30

 1/16 [>.............................] - ETA: 0s - loss: 2.3962 - accuracy: 0.3360
 4/16 [======>.......................] - ETA: 0s - loss: 2.3413 - accuracy: 0.3440
 7/16 [============>.................] - ETA: 0s - loss: 2.3298 - accuracy: 0.3480
10/16 [=================>............] - ETA: 0s - loss: 2.3309 - accuracy: 0.3476
13/16 [=======================>......] - ETA: 0s - loss: 2.3212 - accuracy: 0.3523
16/16 [==============================] - 0s 17ms/step - loss: 2.3265 - accuracy: 0.3519

16/16 [==============================] - 0s 26ms/step - loss: 2.3265 - accuracy: 0.3519 - val_loss: 2.3119 - val_accuracy: 0.3550
Epoch 21/30

 1/16 [>.............................] - ETA: 0s - loss: 2.3677 - accuracy: 0.3660
 4/16 [======>.......................] - ETA: 0s - loss: 2.3142 - accuracy: 0.3525
 7/16 [============>.................] - ETA: 0s - loss: 2.3073 - accuracy: 0.3546
10/16 [=================>............] - ETA: 0s - loss: 2.3101 - accuracy: 0.3554
13/16 [=======================>......] - ETA: 0s - loss: 2.3169 - accuracy: 0.3523
16/16 [==============================] - 0s 17ms/step - loss: 2.3133 - accuracy: 0.3540

16/16 [==============================] - 0s 27ms/step - loss: 2.3133 - accuracy: 0.3540 - val_loss: 2.2984 - val_accuracy: 0.3630
Epoch 22/30

 1/16 [>.............................] - ETA: 0s - loss: 2.3983 - accuracy: 0.3620
 4/16 [======>.......................] - ETA: 0s - loss: 2.3083 - accuracy: 0.3555
 7/16 [============>.................] - ETA: 0s - loss: 2.3107 - accuracy: 0.3537
10/16 [=================>............] - ETA: 0s - loss: 2.3114 - accuracy: 0.3560
14/16 [=========================>....] - ETA: 0s - loss: 2.3008 - accuracy: 0.3616
16/16 [==============================] - 0s 16ms/step - loss: 2.2997 - accuracy: 0.3597

16/16 [==============================] - 0s 26ms/step - loss: 2.2997 - accuracy: 0.3597 - val_loss: 2.2844 - val_accuracy: 0.3630
Epoch 23/30

 1/16 [>.............................] - ETA: 0s - loss: 2.2598 - accuracy: 0.3580
 4/16 [======>.......................] - ETA: 0s - loss: 2.2966 - accuracy: 0.3615
 7/16 [============>.................] - ETA: 0s - loss: 2.3280 - accuracy: 0.3554
10/16 [=================>............] - ETA: 0s - loss: 2.3153 - accuracy: 0.3580
13/16 [=======================>......] - ETA: 0s - loss: 2.2977 - accuracy: 0.3620
16/16 [==============================] - 0s 17ms/step - loss: 2.2855 - accuracy: 0.3658

16/16 [==============================] - 0s 27ms/step - loss: 2.2855 - accuracy: 0.3658 - val_loss: 2.2698 - val_accuracy: 0.3730
Epoch 24/30

 1/16 [>.............................] - ETA: 0s - loss: 2.2765 - accuracy: 0.3600
 4/16 [======>.......................] - ETA: 0s - loss: 2.2385 - accuracy: 0.3785
 7/16 [============>.................] - ETA: 0s - loss: 2.2510 - accuracy: 0.3751
10/16 [=================>............] - ETA: 0s - loss: 2.2686 - accuracy: 0.3728
13/16 [=======================>......] - ETA: 0s - loss: 2.2675 - accuracy: 0.3706
16/16 [==============================] - 0s 17ms/step - loss: 2.2705 - accuracy: 0.3720

16/16 [==============================] - 0s 27ms/step - loss: 2.2705 - accuracy: 0.3720 - val_loss: 2.2543 - val_accuracy: 0.3810
Epoch 25/30

 1/16 [>.............................] - ETA: 0s - loss: 2.2159 - accuracy: 0.3740
 4/16 [======>.......................] - ETA: 0s - loss: 2.2392 - accuracy: 0.3675
 7/16 [============>.................] - ETA: 0s - loss: 2.2644 - accuracy: 0.3709
10/16 [=================>............] - ETA: 0s - loss: 2.2507 - accuracy: 0.3790
14/16 [=========================>....] - ETA: 0s - loss: 2.2555 - accuracy: 0.3783
16/16 [==============================] - 0s 16ms/step - loss: 2.2548 - accuracy: 0.3817

16/16 [==============================] - 0s 26ms/step - loss: 2.2548 - accuracy: 0.3817 - val_loss: 2.2378 - val_accuracy: 0.3890
Epoch 26/30

 1/16 [>.............................] - ETA: 0s - loss: 2.3016 - accuracy: 0.3820
 4/16 [======>.......................] - ETA: 0s - loss: 2.2484 - accuracy: 0.3860
 7/16 [============>.................] - ETA: 0s - loss: 2.2391 - accuracy: 0.3926
10/16 [=================>............] - ETA: 0s - loss: 2.2453 - accuracy: 0.3920
14/16 [=========================>....] - ETA: 0s - loss: 2.2498 - accuracy: 0.3896
16/16 [==============================] - 0s 16ms/step - loss: 2.2381 - accuracy: 0.3906

16/16 [==============================] - 0s 26ms/step - loss: 2.2381 - accuracy: 0.3906 - val_loss: 2.2207 - val_accuracy: 0.3950
Epoch 27/30

 1/16 [>.............................] - ETA: 0s - loss: 2.3065 - accuracy: 0.3800
 4/16 [======>.......................] - ETA: 0s - loss: 2.2416 - accuracy: 0.3860
 7/16 [============>.................] - ETA: 0s - loss: 2.2432 - accuracy: 0.3914
10/16 [=================>............] - ETA: 0s - loss: 2.2242 - accuracy: 0.3964
13/16 [=======================>......] - ETA: 0s - loss: 2.2220 - accuracy: 0.3965
16/16 [==============================] - 0s 17ms/step - loss: 2.2203 - accuracy: 0.3996

16/16 [==============================] - 0s 27ms/step - loss: 2.2203 - accuracy: 0.3996 - val_loss: 2.2027 - val_accuracy: 0.4070
Epoch 28/30

 1/16 [>.............................] - ETA: 0s - loss: 2.3593 - accuracy: 0.3880
 4/16 [======>.......................] - ETA: 0s - loss: 2.2637 - accuracy: 0.3990
 7/16 [============>.................] - ETA: 0s - loss: 2.2149 - accuracy: 0.4094
11/16 [===================>..........] - ETA: 0s - loss: 2.2089 - accuracy: 0.4102
15/16 [===========================>..] - ETA: 0s - loss: 2.1987 - accuracy: 0.4120
16/16 [==============================] - 0s 16ms/step - loss: 2.2018 - accuracy: 0.4105

16/16 [==============================] - 0s 26ms/step - loss: 2.2018 - accuracy: 0.4105 - val_loss: 2.1838 - val_accuracy: 0.4240
Epoch 29/30

 1/16 [>.............................] - ETA: 0s - loss: 2.1032 - accuracy: 0.4480
 5/16 [========>.....................] - ETA: 0s - loss: 2.2046 - accuracy: 0.4220
 8/16 [==============>...............] - ETA: 0s - loss: 2.1950 - accuracy: 0.4265
11/16 [===================>..........] - ETA: 0s - loss: 2.1836 - accuracy: 0.4293
14/16 [=========================>....] - ETA: 0s - loss: 2.1836 - accuracy: 0.4289
16/16 [==============================] - 0s 16ms/step - loss: 2.1824 - accuracy: 0.4307

16/16 [==============================] - 0s 26ms/step - loss: 2.1824 - accuracy: 0.4307 - val_loss: 2.1642 - val_accuracy: 0.4510
Epoch 30/30

 1/16 [>.............................] - ETA: 0s - loss: 2.2916 - accuracy: 0.4020
 4/16 [======>.......................] - ETA: 0s - loss: 2.2286 - accuracy: 0.4230
 7/16 [============>.................] - ETA: 0s - loss: 2.1905 - accuracy: 0.4334
11/16 [===================>..........] - ETA: 0s - loss: 2.1701 - accuracy: 0.4398
15/16 [===========================>..] - ETA: 0s - loss: 2.1609 - accuracy: 0.4496
16/16 [==============================] - 0s 16ms/step - loss: 2.1622 - accuracy: 0.4495

16/16 [==============================] - 0s 25ms/step - loss: 2.1622 - accuracy: 0.4495 - val_loss: 2.1441 - val_accuracy: 0.4670

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-01T18-48-09Z

Training run 3/8 (flags = list(128, 0.01, 200, 30, "relu")) 
Using run directory runs/2020-11-01T18-48-25Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = 10000) %>%
+         layer_dense( units = FLAGS$n .... [TRUNCATED] 

> set.seed(123)

> model %>% compile (
+         loss = 'sparse_categorical_crossentropy',
+         optimizer = optimizer_adam(lr=FLAGS$learning_rate),
+         metr .... [TRUNCATED] 

> model %>% fit (x = reuters_train, y = reuters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = list(reuters_val .... [TRUNCATED] 
Epoch 1/30

 1/40 [..............................] - ETA: 0s - loss: 3.8585 - accuracy: 0.0150
 7/40 [====>.........................] - ETA: 0s - loss: 2.6779 - accuracy: 0.3714
13/40 [========>.....................] - ETA: 0s - loss: 2.2384 - accuracy: 0.4700
19/40 [=============>................] - ETA: 0s - loss: 2.0092 - accuracy: 0.5339
25/40 [=================>............] - ETA: 0s - loss: 1.8369 - accuracy: 0.5774
32/40 [=======================>......] - ETA: 0s - loss: 1.7189 - accuracy: 0.6059
39/40 [============================>.] - ETA: 0s - loss: 1.6223 - accuracy: 0.6294
40/40 [==============================] - 0s 9ms/step - loss: 1.6147 - accuracy: 0.6307

40/40 [==============================] - 1s 24ms/step - loss: 1.6147 - accuracy: 0.6307 - val_loss: 1.1528 - val_accuracy: 0.7290
Epoch 2/30

 1/40 [..............................] - ETA: 0s - loss: 0.9234 - accuracy: 0.7650
 7/40 [====>.........................] - ETA: 0s - loss: 0.9063 - accuracy: 0.7707
13/40 [========>.....................] - ETA: 0s - loss: 0.8900 - accuracy: 0.7742
19/40 [=============>................] - ETA: 0s - loss: 0.8284 - accuracy: 0.7921
25/40 [=================>............] - ETA: 0s - loss: 0.8106 - accuracy: 0.7978
31/40 [======================>.......] - ETA: 0s - loss: 0.7863 - accuracy: 0.8040
37/40 [==========================>...] - ETA: 0s - loss: 0.7909 - accuracy: 0.8035
40/40 [==============================] - 0s 9ms/step - loss: 0.7852 - accuracy: 0.8054

40/40 [==============================] - 1s 13ms/step - loss: 0.7852 - accuracy: 0.8054 - val_loss: 0.9687 - val_accuracy: 0.7780
Epoch 3/30

 1/40 [..............................] - ETA: 0s - loss: 0.5479 - accuracy: 0.8550
 7/40 [====>.........................] - ETA: 0s - loss: 0.4698 - accuracy: 0.8736
13/40 [========>.....................] - ETA: 0s - loss: 0.4447 - accuracy: 0.8788
19/40 [=============>................] - ETA: 0s - loss: 0.4449 - accuracy: 0.8792
25/40 [=================>............] - ETA: 0s - loss: 0.4446 - accuracy: 0.8822
31/40 [======================>.......] - ETA: 0s - loss: 0.4496 - accuracy: 0.8813
37/40 [==========================>...] - ETA: 0s - loss: 0.4501 - accuracy: 0.8819
40/40 [==============================] - 0s 9ms/step - loss: 0.4489 - accuracy: 0.8825

40/40 [==============================] - 1s 13ms/step - loss: 0.4489 - accuracy: 0.8825 - val_loss: 0.9856 - val_accuracy: 0.7890
Epoch 4/30

 1/40 [..............................] - ETA: 0s - loss: 0.2036 - accuracy: 0.9350
 7/40 [====>.........................] - ETA: 0s - loss: 0.2800 - accuracy: 0.9200
12/40 [========>.....................] - ETA: 0s - loss: 0.2931 - accuracy: 0.9158
18/40 [============>.................] - ETA: 0s - loss: 0.3053 - accuracy: 0.9150
24/40 [=================>............] - ETA: 0s - loss: 0.2999 - accuracy: 0.9171
30/40 [=====================>........] - ETA: 0s - loss: 0.3073 - accuracy: 0.9128
36/40 [==========================>...] - ETA: 0s - loss: 0.3140 - accuracy: 0.9137
40/40 [==============================] - 0s 9ms/step - loss: 0.3186 - accuracy: 0.9132

40/40 [==============================] - 1s 13ms/step - loss: 0.3186 - accuracy: 0.9132 - val_loss: 1.0235 - val_accuracy: 0.7960
Epoch 5/30

 1/40 [..............................] - ETA: 0s - loss: 0.1505 - accuracy: 0.9550
 7/40 [====>.........................] - ETA: 0s - loss: 0.1963 - accuracy: 0.9457
13/40 [========>.....................] - ETA: 0s - loss: 0.2066 - accuracy: 0.9454
19/40 [=============>................] - ETA: 0s - loss: 0.2219 - accuracy: 0.9400
25/40 [=================>............] - ETA: 0s - loss: 0.2270 - accuracy: 0.9368
31/40 [======================>.......] - ETA: 0s - loss: 0.2492 - accuracy: 0.9318
37/40 [==========================>...] - ETA: 0s - loss: 0.2558 - accuracy: 0.9292
40/40 [==============================] - 0s 9ms/step - loss: 0.2532 - accuracy: 0.9296

40/40 [==============================] - 1s 13ms/step - loss: 0.2532 - accuracy: 0.9296 - val_loss: 1.0024 - val_accuracy: 0.7970
Epoch 6/30

 1/40 [..............................] - ETA: 0s - loss: 0.1803 - accuracy: 0.9400
 7/40 [====>.........................] - ETA: 0s - loss: 0.1869 - accuracy: 0.9407
12/40 [========>.....................] - ETA: 0s - loss: 0.1677 - accuracy: 0.9479
18/40 [============>.................] - ETA: 0s - loss: 0.1697 - accuracy: 0.9519
24/40 [=================>............] - ETA: 0s - loss: 0.1784 - accuracy: 0.9494
30/40 [=====================>........] - ETA: 0s - loss: 0.1852 - accuracy: 0.9457
36/40 [==========================>...] - ETA: 0s - loss: 0.1875 - accuracy: 0.9443
40/40 [==============================] - 0s 9ms/step - loss: 0.1926 - accuracy: 0.9424

40/40 [==============================] - 1s 13ms/step - loss: 0.1926 - accuracy: 0.9424 - val_loss: 1.1869 - val_accuracy: 0.7900
Epoch 7/30

 1/40 [..............................] - ETA: 0s - loss: 0.1183 - accuracy: 0.9650
 7/40 [====>.........................] - ETA: 0s - loss: 0.1348 - accuracy: 0.9536
12/40 [========>.....................] - ETA: 0s - loss: 0.1682 - accuracy: 0.9479
18/40 [============>.................] - ETA: 0s - loss: 0.1668 - accuracy: 0.9478
24/40 [=================>............] - ETA: 0s - loss: 0.1703 - accuracy: 0.9467
30/40 [=====================>........] - ETA: 0s - loss: 0.1675 - accuracy: 0.9480
36/40 [==========================>...] - ETA: 0s - loss: 0.1713 - accuracy: 0.9478
40/40 [==============================] - 0s 9ms/step - loss: 0.1701 - accuracy: 0.9484

40/40 [==============================] - 1s 13ms/step - loss: 0.1701 - accuracy: 0.9484 - val_loss: 1.2134 - val_accuracy: 0.7980
Epoch 8/30

 1/40 [..............................] - ETA: 0s - loss: 0.1265 - accuracy: 0.9550
 7/40 [====>.........................] - ETA: 0s - loss: 0.1274 - accuracy: 0.9586
13/40 [========>.....................] - ETA: 0s - loss: 0.1256 - accuracy: 0.9581
19/40 [=============>................] - ETA: 0s - loss: 0.1263 - accuracy: 0.9582
25/40 [=================>............] - ETA: 0s - loss: 0.1397 - accuracy: 0.9564
31/40 [======================>.......] - ETA: 0s - loss: 0.1384 - accuracy: 0.9547
37/40 [==========================>...] - ETA: 0s - loss: 0.1372 - accuracy: 0.9547
40/40 [==============================] - 0s 9ms/step - loss: 0.1381 - accuracy: 0.9543

40/40 [==============================] - 1s 13ms/step - loss: 0.1381 - accuracy: 0.9543 - val_loss: 1.3890 - val_accuracy: 0.7920
Epoch 9/30

 1/40 [..............................] - ETA: 0s - loss: 0.0660 - accuracy: 0.9700
 7/40 [====>.........................] - ETA: 0s - loss: 0.0957 - accuracy: 0.9614
13/40 [========>.....................] - ETA: 0s - loss: 0.1064 - accuracy: 0.9615
19/40 [=============>................] - ETA: 0s - loss: 0.1034 - accuracy: 0.9626
25/40 [=================>............] - ETA: 0s - loss: 0.1276 - accuracy: 0.9584
31/40 [======================>.......] - ETA: 0s - loss: 0.1323 - accuracy: 0.9561
37/40 [==========================>...] - ETA: 0s - loss: 0.1354 - accuracy: 0.9550
40/40 [==============================] - 0s 9ms/step - loss: 0.1363 - accuracy: 0.9548

40/40 [==============================] - 1s 14ms/step - loss: 0.1363 - accuracy: 0.9548 - val_loss: 1.3458 - val_accuracy: 0.7930
Epoch 10/30

 1/40 [..............................] - ETA: 0s - loss: 0.0696 - accuracy: 0.9800
 7/40 [====>.........................] - ETA: 0s - loss: 0.1141 - accuracy: 0.9621
13/40 [========>.....................] - ETA: 0s - loss: 0.1018 - accuracy: 0.9615
19/40 [=============>................] - ETA: 0s - loss: 0.1000 - accuracy: 0.9605
25/40 [=================>............] - ETA: 0s - loss: 0.1143 - accuracy: 0.9578
31/40 [======================>.......] - ETA: 0s - loss: 0.1190 - accuracy: 0.9579
37/40 [==========================>...] - ETA: 0s - loss: 0.1234 - accuracy: 0.9565
40/40 [==============================] - 0s 9ms/step - loss: 0.1289 - accuracy: 0.9553

40/40 [==============================] - 1s 13ms/step - loss: 0.1289 - accuracy: 0.9553 - val_loss: 1.3287 - val_accuracy: 0.8020
Epoch 11/30

 1/40 [..............................] - ETA: 0s - loss: 0.0980 - accuracy: 0.9550
 6/40 [===>..........................] - ETA: 0s - loss: 0.1183 - accuracy: 0.9575
11/40 [=======>......................] - ETA: 0s - loss: 0.1060 - accuracy: 0.9586
17/40 [===========>..................] - ETA: 0s - loss: 0.1051 - accuracy: 0.9582
23/40 [================>.............] - ETA: 0s - loss: 0.1043 - accuracy: 0.9600
29/40 [====================>.........] - ETA: 0s - loss: 0.1037 - accuracy: 0.9591
35/40 [=========================>....] - ETA: 0s - loss: 0.1038 - accuracy: 0.9583
40/40 [==============================] - 0s 9ms/step - loss: 0.1106 - accuracy: 0.9582

40/40 [==============================] - 1s 13ms/step - loss: 0.1106 - accuracy: 0.9582 - val_loss: 1.3559 - val_accuracy: 0.7930
Epoch 12/30

 1/40 [..............................] - ETA: 0s - loss: 0.0793 - accuracy: 0.9700
 7/40 [====>.........................] - ETA: 0s - loss: 0.0907 - accuracy: 0.9729
13/40 [========>.....................] - ETA: 0s - loss: 0.0880 - accuracy: 0.9704
19/40 [=============>................] - ETA: 0s - loss: 0.0922 - accuracy: 0.9668
25/40 [=================>............] - ETA: 0s - loss: 0.0960 - accuracy: 0.9646
31/40 [======================>.......] - ETA: 0s - loss: 0.1026 - accuracy: 0.9618
37/40 [==========================>...] - ETA: 0s - loss: 0.0995 - accuracy: 0.9623
40/40 [==============================] - 0s 9ms/step - loss: 0.1013 - accuracy: 0.9617

40/40 [==============================] - 1s 13ms/step - loss: 0.1013 - accuracy: 0.9617 - val_loss: 1.4571 - val_accuracy: 0.7860
Epoch 13/30

 1/40 [..............................] - ETA: 0s - loss: 0.0541 - accuracy: 0.9750
 7/40 [====>.........................] - ETA: 0s - loss: 0.0792 - accuracy: 0.9636
13/40 [========>.....................] - ETA: 0s - loss: 0.0885 - accuracy: 0.9577
19/40 [=============>................] - ETA: 0s - loss: 0.0978 - accuracy: 0.9576
25/40 [=================>............] - ETA: 0s - loss: 0.0971 - accuracy: 0.9586
31/40 [======================>.......] - ETA: 0s - loss: 0.1028 - accuracy: 0.9594
37/40 [==========================>...] - ETA: 0s - loss: 0.1081 - accuracy: 0.9581
40/40 [==============================] - 0s 9ms/step - loss: 0.1102 - accuracy: 0.9579

40/40 [==============================] - 1s 13ms/step - loss: 0.1102 - accuracy: 0.9579 - val_loss: 1.4214 - val_accuracy: 0.7770
Epoch 14/30

 1/40 [..............................] - ETA: 0s - loss: 0.1274 - accuracy: 0.9550
 7/40 [====>.........................] - ETA: 0s - loss: 0.0885 - accuracy: 0.9693
13/40 [========>.....................] - ETA: 0s - loss: 0.0951 - accuracy: 0.9646
19/40 [=============>................] - ETA: 0s - loss: 0.0936 - accuracy: 0.9645
25/40 [=================>............] - ETA: 0s - loss: 0.0931 - accuracy: 0.9632
31/40 [======================>.......] - ETA: 0s - loss: 0.0940 - accuracy: 0.9623
37/40 [==========================>...] - ETA: 0s - loss: 0.0980 - accuracy: 0.9599
40/40 [==============================] - 0s 9ms/step - loss: 0.1051 - accuracy: 0.9585

40/40 [==============================] - 1s 13ms/step - loss: 0.1051 - accuracy: 0.9585 - val_loss: 1.5910 - val_accuracy: 0.7820
Epoch 15/30

 1/40 [..............................] - ETA: 0s - loss: 0.1643 - accuracy: 0.9700
 7/40 [====>.........................] - ETA: 0s - loss: 0.0861 - accuracy: 0.9671
13/40 [========>.....................] - ETA: 0s - loss: 0.0878 - accuracy: 0.9631
19/40 [=============>................] - ETA: 0s - loss: 0.0953 - accuracy: 0.9611
25/40 [=================>............] - ETA: 0s - loss: 0.0969 - accuracy: 0.9602
31/40 [======================>.......] - ETA: 0s - loss: 0.0985 - accuracy: 0.9590
37/40 [==========================>...] - ETA: 0s - loss: 0.1089 - accuracy: 0.9569
40/40 [==============================] - 0s 9ms/step - loss: 0.1143 - accuracy: 0.9555

40/40 [==============================] - 1s 13ms/step - loss: 0.1143 - accuracy: 0.9555 - val_loss: 1.4401 - val_accuracy: 0.7850
Epoch 16/30

 1/40 [..............................] - ETA: 0s - loss: 0.1076 - accuracy: 0.9600
 7/40 [====>.........................] - ETA: 0s - loss: 0.0908 - accuracy: 0.9600
13/40 [========>.....................] - ETA: 0s - loss: 0.1132 - accuracy: 0.9592
19/40 [=============>................] - ETA: 0s - loss: 0.1190 - accuracy: 0.9592
25/40 [=================>............] - ETA: 0s - loss: 0.1292 - accuracy: 0.9556
31/40 [======================>.......] - ETA: 0s - loss: 0.1306 - accuracy: 0.9550
37/40 [==========================>...] - ETA: 0s - loss: 0.1273 - accuracy: 0.9549
40/40 [==============================] - 0s 9ms/step - loss: 0.1257 - accuracy: 0.9553

40/40 [==============================] - 1s 13ms/step - loss: 0.1257 - accuracy: 0.9553 - val_loss: 2.1061 - val_accuracy: 0.7900
Epoch 17/30

 1/40 [..............................] - ETA: 0s - loss: 0.0647 - accuracy: 0.9750
 7/40 [====>.........................] - ETA: 0s - loss: 0.0885 - accuracy: 0.9600
13/40 [========>.....................] - ETA: 0s - loss: 0.0856 - accuracy: 0.9631
19/40 [=============>................] - ETA: 0s - loss: 0.1121 - accuracy: 0.9574
25/40 [=================>............] - ETA: 0s - loss: 0.1220 - accuracy: 0.9558
31/40 [======================>.......] - ETA: 0s - loss: 0.1273 - accuracy: 0.9542
37/40 [==========================>...] - ETA: 0s - loss: 0.1300 - accuracy: 0.9527
40/40 [==============================] - 0s 9ms/step - loss: 0.1307 - accuracy: 0.9524

40/40 [==============================] - 1s 13ms/step - loss: 0.1307 - accuracy: 0.9524 - val_loss: 1.7993 - val_accuracy: 0.7910
Epoch 18/30

 1/40 [..............................] - ETA: 0s - loss: 0.0961 - accuracy: 0.9750
 7/40 [====>.........................] - ETA: 0s - loss: 0.1180 - accuracy: 0.9607
13/40 [========>.....................] - ETA: 0s - loss: 0.1299 - accuracy: 0.9612
19/40 [=============>................] - ETA: 0s - loss: 0.1252 - accuracy: 0.9595
25/40 [=================>............] - ETA: 0s - loss: 0.1220 - accuracy: 0.9584
31/40 [======================>.......] - ETA: 0s - loss: 0.1297 - accuracy: 0.9556
37/40 [==========================>...] - ETA: 0s - loss: 0.1329 - accuracy: 0.9546
40/40 [==============================] - 0s 9ms/step - loss: 0.1332 - accuracy: 0.9539

40/40 [==============================] - 1s 13ms/step - loss: 0.1332 - accuracy: 0.9539 - val_loss: 1.8322 - val_accuracy: 0.7810
Epoch 19/30

 1/40 [..............................] - ETA: 0s - loss: 0.0625 - accuracy: 0.9700
 7/40 [====>.........................] - ETA: 0s - loss: 0.0733 - accuracy: 0.9686
13/40 [========>.....................] - ETA: 0s - loss: 0.0955 - accuracy: 0.9650
19/40 [=============>................] - ETA: 0s - loss: 0.1150 - accuracy: 0.9603
25/40 [=================>............] - ETA: 0s - loss: 0.1226 - accuracy: 0.9586
31/40 [======================>.......] - ETA: 0s - loss: 0.1302 - accuracy: 0.9553
38/40 [===========================>..] - ETA: 0s - loss: 0.1362 - accuracy: 0.9529
40/40 [==============================] - 0s 9ms/step - loss: 0.1351 - accuracy: 0.9528

40/40 [==============================] - 1s 13ms/step - loss: 0.1351 - accuracy: 0.9528 - val_loss: 1.6183 - val_accuracy: 0.7830
Epoch 20/30

 1/40 [..............................] - ETA: 0s - loss: 0.1226 - accuracy: 0.9500
 7/40 [====>.........................] - ETA: 0s - loss: 0.1021 - accuracy: 0.9586
12/40 [========>.....................] - ETA: 0s - loss: 0.0979 - accuracy: 0.9613
17/40 [===========>..................] - ETA: 0s - loss: 0.0996 - accuracy: 0.9635
23/40 [================>.............] - ETA: 0s - loss: 0.1081 - accuracy: 0.9617
29/40 [====================>.........] - ETA: 0s - loss: 0.1223 - accuracy: 0.9588
35/40 [=========================>....] - ETA: 0s - loss: 0.1253 - accuracy: 0.9561
40/40 [==============================] - 0s 9ms/step - loss: 0.1272 - accuracy: 0.9538

40/40 [==============================] - 1s 13ms/step - loss: 0.1272 - accuracy: 0.9538 - val_loss: 1.9284 - val_accuracy: 0.7900
Epoch 21/30

 1/40 [..............................] - ETA: 0s - loss: 0.0689 - accuracy: 0.9650
 7/40 [====>.........................] - ETA: 0s - loss: 0.1010 - accuracy: 0.9564
13/40 [========>.....................] - ETA: 0s - loss: 0.0964 - accuracy: 0.9592
19/40 [=============>................] - ETA: 0s - loss: 0.0985 - accuracy: 0.9603
25/40 [=================>............] - ETA: 0s - loss: 0.1101 - accuracy: 0.9582
31/40 [======================>.......] - ETA: 0s - loss: 0.1097 - accuracy: 0.9581
37/40 [==========================>...] - ETA: 0s - loss: 0.1131 - accuracy: 0.9576
40/40 [==============================] - 0s 9ms/step - loss: 0.1145 - accuracy: 0.9577

40/40 [==============================] - 1s 13ms/step - loss: 0.1145 - accuracy: 0.9577 - val_loss: 1.7089 - val_accuracy: 0.7810
Epoch 22/30

 1/40 [..............................] - ETA: 0s - loss: 0.0702 - accuracy: 0.9700
 7/40 [====>.........................] - ETA: 0s - loss: 0.0931 - accuracy: 0.9607
13/40 [========>.....................] - ETA: 0s - loss: 0.1039 - accuracy: 0.9585
19/40 [=============>................] - ETA: 0s - loss: 0.1041 - accuracy: 0.9555
25/40 [=================>............] - ETA: 0s - loss: 0.1062 - accuracy: 0.9544
31/40 [======================>.......] - ETA: 0s - loss: 0.1097 - accuracy: 0.9548
37/40 [==========================>...] - ETA: 0s - loss: 0.1123 - accuracy: 0.9554
40/40 [==============================] - 0s 9ms/step - loss: 0.1115 - accuracy: 0.9557

40/40 [==============================] - 1s 13ms/step - loss: 0.1115 - accuracy: 0.9557 - val_loss: 2.0339 - val_accuracy: 0.7690
Epoch 23/30

 1/40 [..............................] - ETA: 0s - loss: 0.1234 - accuracy: 0.9650
 7/40 [====>.........................] - ETA: 0s - loss: 0.1277 - accuracy: 0.9514
13/40 [========>.....................] - ETA: 0s - loss: 0.1152 - accuracy: 0.9581
19/40 [=============>................] - ETA: 0s - loss: 0.1165 - accuracy: 0.9587
25/40 [=================>............] - ETA: 0s - loss: 0.1210 - accuracy: 0.9554
31/40 [======================>.......] - ETA: 0s - loss: 0.1223 - accuracy: 0.9548
37/40 [==========================>...] - ETA: 0s - loss: 0.1266 - accuracy: 0.9539
40/40 [==============================] - 0s 9ms/step - loss: 0.1255 - accuracy: 0.9540

40/40 [==============================] - 1s 13ms/step - loss: 0.1255 - accuracy: 0.9540 - val_loss: 2.0272 - val_accuracy: 0.7760
Epoch 24/30

 1/40 [..............................] - ETA: 0s - loss: 0.0985 - accuracy: 0.9600
 7/40 [====>.........................] - ETA: 0s - loss: 0.1097 - accuracy: 0.9600
14/40 [=========>....................] - ETA: 0s - loss: 0.1135 - accuracy: 0.9550
20/40 [==============>...............] - ETA: 0s - loss: 0.1166 - accuracy: 0.9550
26/40 [==================>...........] - ETA: 0s - loss: 0.1362 - accuracy: 0.9517
32/40 [=======================>......] - ETA: 0s - loss: 0.1422 - accuracy: 0.9511
38/40 [===========================>..] - ETA: 0s - loss: 0.1443 - accuracy: 0.9505
40/40 [==============================] - 0s 8ms/step - loss: 0.1423 - accuracy: 0.9510

40/40 [==============================] - 0s 12ms/step - loss: 0.1423 - accuracy: 0.9510 - val_loss: 2.0351 - val_accuracy: 0.7820
Epoch 25/30

 1/40 [..............................] - ETA: 0s - loss: 0.0910 - accuracy: 0.9550
 7/40 [====>.........................] - ETA: 0s - loss: 0.1326 - accuracy: 0.9629
13/40 [========>.....................] - ETA: 0s - loss: 0.1342 - accuracy: 0.9608
19/40 [=============>................] - ETA: 0s - loss: 0.1422 - accuracy: 0.9558
25/40 [=================>............] - ETA: 0s - loss: 0.1359 - accuracy: 0.9552
31/40 [======================>.......] - ETA: 0s - loss: 0.1435 - accuracy: 0.9537
37/40 [==========================>...] - ETA: 0s - loss: 0.1425 - accuracy: 0.9530
40/40 [==============================] - 0s 9ms/step - loss: 0.1446 - accuracy: 0.9529

40/40 [==============================] - 1s 13ms/step - loss: 0.1446 - accuracy: 0.9529 - val_loss: 2.0141 - val_accuracy: 0.7880
Epoch 26/30

 1/40 [..............................] - ETA: 0s - loss: 0.0951 - accuracy: 0.9750
 7/40 [====>.........................] - ETA: 0s - loss: 0.0870 - accuracy: 0.9650
13/40 [========>.....................] - ETA: 0s - loss: 0.1085 - accuracy: 0.9569
18/40 [============>.................] - ETA: 0s - loss: 0.1066 - accuracy: 0.9567
24/40 [=================>............] - ETA: 0s - loss: 0.1065 - accuracy: 0.9571
30/40 [=====================>........] - ETA: 0s - loss: 0.1121 - accuracy: 0.9577
36/40 [==========================>...] - ETA: 0s - loss: 0.1229 - accuracy: 0.9549
40/40 [==============================] - 0s 9ms/step - loss: 0.1329 - accuracy: 0.9529

40/40 [==============================] - 1s 13ms/step - loss: 0.1329 - accuracy: 0.9529 - val_loss: 2.0712 - val_accuracy: 0.7770
Epoch 27/30

 1/40 [..............................] - ETA: 0s - loss: 0.1279 - accuracy: 0.9550
 7/40 [====>.........................] - ETA: 0s - loss: 0.1636 - accuracy: 0.9543
13/40 [========>.....................] - ETA: 0s - loss: 0.1537 - accuracy: 0.9508
19/40 [=============>................] - ETA: 0s - loss: 0.1540 - accuracy: 0.9516
25/40 [=================>............] - ETA: 0s - loss: 0.1492 - accuracy: 0.9518
31/40 [======================>.......] - ETA: 0s - loss: 0.1391 - accuracy: 0.9532
38/40 [===========================>..] - ETA: 0s - loss: 0.1560 - accuracy: 0.9513
40/40 [==============================] - 0s 8ms/step - loss: 0.1610 - accuracy: 0.9495

40/40 [==============================] - 0s 12ms/step - loss: 0.1610 - accuracy: 0.9495 - val_loss: 2.1998 - val_accuracy: 0.7830
Epoch 28/30

 1/40 [..............................] - ETA: 0s - loss: 0.0794 - accuracy: 0.9600
 7/40 [====>.........................] - ETA: 0s - loss: 0.1130 - accuracy: 0.9550
13/40 [========>.....................] - ETA: 0s - loss: 0.1395 - accuracy: 0.9546
19/40 [=============>................] - ETA: 0s - loss: 0.1382 - accuracy: 0.9534
25/40 [=================>............] - ETA: 0s - loss: 0.1451 - accuracy: 0.9496
31/40 [======================>.......] - ETA: 0s - loss: 0.1565 - accuracy: 0.9487
37/40 [==========================>...] - ETA: 0s - loss: 0.1662 - accuracy: 0.9473
40/40 [==============================] - 0s 9ms/step - loss: 0.1652 - accuracy: 0.9469

40/40 [==============================] - 1s 13ms/step - loss: 0.1652 - accuracy: 0.9469 - val_loss: 2.1589 - val_accuracy: 0.7750
Epoch 29/30

 1/40 [..............................] - ETA: 0s - loss: 0.1231 - accuracy: 0.9650
 7/40 [====>.........................] - ETA: 0s - loss: 0.1144 - accuracy: 0.9564
13/40 [========>.....................] - ETA: 0s - loss: 0.1396 - accuracy: 0.9523
19/40 [=============>................] - ETA: 0s - loss: 0.1412 - accuracy: 0.9532
25/40 [=================>............] - ETA: 0s - loss: 0.1421 - accuracy: 0.9542
31/40 [======================>.......] - ETA: 0s - loss: 0.1417 - accuracy: 0.9544
37/40 [==========================>...] - ETA: 0s - loss: 0.1416 - accuracy: 0.9549
40/40 [==============================] - 0s 9ms/step - loss: 0.1452 - accuracy: 0.9543

40/40 [==============================] - 1s 13ms/step - loss: 0.1452 - accuracy: 0.9543 - val_loss: 2.2907 - val_accuracy: 0.7860
Epoch 30/30

 1/40 [..............................] - ETA: 0s - loss: 0.0742 - accuracy: 0.9550
 7/40 [====>.........................] - ETA: 0s - loss: 0.0971 - accuracy: 0.9629
13/40 [========>.....................] - ETA: 0s - loss: 0.1169 - accuracy: 0.9600
19/40 [=============>................] - ETA: 0s - loss: 0.1157 - accuracy: 0.9613
25/40 [=================>............] - ETA: 0s - loss: 0.1276 - accuracy: 0.9574
31/40 [======================>.......] - ETA: 0s - loss: 0.1260 - accuracy: 0.9565
37/40 [==========================>...] - ETA: 0s - loss: 0.1334 - accuracy: 0.9558
40/40 [==============================] - 0s 9ms/step - loss: 0.1362 - accuracy: 0.9549

40/40 [==============================] - 1s 13ms/step - loss: 0.1362 - accuracy: 0.9549 - val_loss: 2.3400 - val_accuracy: 0.7780

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-01T18-48-25Z

Training run 4/8 (flags = list(392, 0.01, 100, 50, "sigmoid")) 
Using run directory runs/2020-11-01T18-48-42Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = 10000) %>%
+         layer_dense( units = FLAGS$n .... [TRUNCATED] 

> set.seed(123)

> model %>% compile (
+         loss = 'sparse_categorical_crossentropy',
+         optimizer = optimizer_adam(lr=FLAGS$learning_rate),
+         metr .... [TRUNCATED] 

> model %>% fit (x = reuters_train, y = reuters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = list(reuters_val .... [TRUNCATED] 
Epoch 1/50

 1/80 [..............................] - ETA: 0s - loss: 4.1026 - accuracy: 0.0000e+00
 5/80 [>.............................] - ETA: 0s - loss: 3.9103 - accuracy: 0.2200    
 9/80 [==>...........................] - ETA: 0s - loss: 3.4626 - accuracy: 0.2744
13/80 [===>..........................] - ETA: 0s - loss: 3.1969 - accuracy: 0.3077
16/80 [=====>........................] - ETA: 0s - loss: 3.0590 - accuracy: 0.3206
20/80 [======>.......................] - ETA: 0s - loss: 2.9053 - accuracy: 0.3440
24/80 [========>.....................] - ETA: 0s - loss: 2.7904 - accuracy: 0.3679
28/80 [=========>....................] - ETA: 0s - loss: 2.7268 - accuracy: 0.3796
32/80 [===========>..................] - ETA: 0s - loss: 2.6413 - accuracy: 0.3963
36/80 [============>.................] - ETA: 0s - loss: 2.5664 - accuracy: 0.4114
40/80 [==============>...............] - ETA: 0s - loss: 2.5011 - accuracy: 0.4243
44/80 [===============>..............] - ETA: 0s - loss: 2.4249 - accuracy: 0.4405
48/80 [=================>............] - ETA: 0s - loss: 2.3634 - accuracy: 0.4519
52/80 [==================>...........] - ETA: 0s - loss: 2.3139 - accuracy: 0.4615
56/80 [====================>.........] - ETA: 0s - loss: 2.2629 - accuracy: 0.4707
60/80 [=====================>........] - ETA: 0s - loss: 2.2062 - accuracy: 0.4812
64/80 [=======================>......] - ETA: 0s - loss: 2.1633 - accuracy: 0.4889
68/80 [========================>.....] - ETA: 0s - loss: 2.1273 - accuracy: 0.4937
72/80 [==========================>...] - ETA: 0s - loss: 2.0874 - accuracy: 0.5003
76/80 [===========================>..] - ETA: 0s - loss: 2.0526 - accuracy: 0.5082
80/80 [==============================] - 1s 14ms/step - loss: 2.0288 - accuracy: 0.5139

80/80 [==============================] - 2s 22ms/step - loss: 2.0288 - accuracy: 0.5139 - val_loss: 1.4391 - val_accuracy: 0.6450
Epoch 2/50

 1/80 [..............................] - ETA: 0s - loss: 1.2740 - accuracy: 0.7000
 5/80 [>.............................] - ETA: 0s - loss: 1.3422 - accuracy: 0.6740
 9/80 [==>...........................] - ETA: 0s - loss: 1.3696 - accuracy: 0.6567
13/80 [===>..........................] - ETA: 0s - loss: 1.2971 - accuracy: 0.6723
17/80 [=====>........................] - ETA: 0s - loss: 1.2804 - accuracy: 0.6729
21/80 [======>.......................] - ETA: 0s - loss: 1.2666 - accuracy: 0.6795
25/80 [========>.....................] - ETA: 0s - loss: 1.2658 - accuracy: 0.6756
29/80 [=========>....................] - ETA: 0s - loss: 1.2442 - accuracy: 0.6821
33/80 [===========>..................] - ETA: 0s - loss: 1.2268 - accuracy: 0.6885
37/80 [============>.................] - ETA: 0s - loss: 1.2129 - accuracy: 0.6922
41/80 [==============>...............] - ETA: 0s - loss: 1.2035 - accuracy: 0.6944
45/80 [===============>..............] - ETA: 0s - loss: 1.1990 - accuracy: 0.6987
49/80 [=================>............] - ETA: 0s - loss: 1.2006 - accuracy: 0.7000
53/80 [==================>...........] - ETA: 0s - loss: 1.1941 - accuracy: 0.7008
57/80 [====================>.........] - ETA: 0s - loss: 1.1824 - accuracy: 0.7033
61/80 [=====================>........] - ETA: 0s - loss: 1.1623 - accuracy: 0.7080
65/80 [=======================>......] - ETA: 0s - loss: 1.1577 - accuracy: 0.7092
69/80 [========================>.....] - ETA: 0s - loss: 1.1562 - accuracy: 0.7094
73/80 [==========================>...] - ETA: 0s - loss: 1.1493 - accuracy: 0.7116
77/80 [===========================>..] - ETA: 0s - loss: 1.1425 - accuracy: 0.7143
80/80 [==============================] - 1s 13ms/step - loss: 1.1379 - accuracy: 0.7160

80/80 [==============================] - 1s 16ms/step - loss: 1.1379 - accuracy: 0.7160 - val_loss: 1.0885 - val_accuracy: 0.7220
Epoch 3/50

 1/80 [..............................] - ETA: 0s - loss: 0.6921 - accuracy: 0.7900
 5/80 [>.............................] - ETA: 0s - loss: 0.8494 - accuracy: 0.7760
 9/80 [==>...........................] - ETA: 0s - loss: 0.8289 - accuracy: 0.7900
13/80 [===>..........................] - ETA: 0s - loss: 0.8178 - accuracy: 0.7954
17/80 [=====>........................] - ETA: 0s - loss: 0.8007 - accuracy: 0.7976
21/80 [======>.......................] - ETA: 0s - loss: 0.8057 - accuracy: 0.7981
25/80 [========>.....................] - ETA: 0s - loss: 0.7821 - accuracy: 0.8036
28/80 [=========>....................] - ETA: 0s - loss: 0.7895 - accuracy: 0.8036
32/80 [===========>..................] - ETA: 0s - loss: 0.7964 - accuracy: 0.8016
36/80 [============>.................] - ETA: 0s - loss: 0.8094 - accuracy: 0.7989
40/80 [==============>...............] - ETA: 0s - loss: 0.8068 - accuracy: 0.7983
44/80 [===============>..............] - ETA: 0s - loss: 0.7904 - accuracy: 0.8011
48/80 [=================>............] - ETA: 0s - loss: 0.7955 - accuracy: 0.8015
52/80 [==================>...........] - ETA: 0s - loss: 0.7886 - accuracy: 0.8046
56/80 [====================>.........] - ETA: 0s - loss: 0.7890 - accuracy: 0.8037
60/80 [=====================>........] - ETA: 0s - loss: 0.7900 - accuracy: 0.8028
64/80 [=======================>......] - ETA: 0s - loss: 0.7839 - accuracy: 0.8052
68/80 [========================>.....] - ETA: 0s - loss: 0.7781 - accuracy: 0.8066
72/80 [==========================>...] - ETA: 0s - loss: 0.7774 - accuracy: 0.8071
76/80 [===========================>..] - ETA: 0s - loss: 0.7758 - accuracy: 0.8079
80/80 [==============================] - 1s 14ms/step - loss: 0.7767 - accuracy: 0.8078

80/80 [==============================] - 1s 16ms/step - loss: 0.7767 - accuracy: 0.8078 - val_loss: 1.0899 - val_accuracy: 0.7440
Epoch 4/50

 1/80 [..............................] - ETA: 0s - loss: 0.4479 - accuracy: 0.8700
 5/80 [>.............................] - ETA: 0s - loss: 0.5985 - accuracy: 0.8440
 9/80 [==>...........................] - ETA: 0s - loss: 0.5949 - accuracy: 0.8511
13/80 [===>..........................] - ETA: 0s - loss: 0.5746 - accuracy: 0.8569
17/80 [=====>........................] - ETA: 0s - loss: 0.5721 - accuracy: 0.8565
21/80 [======>.......................] - ETA: 0s - loss: 0.5953 - accuracy: 0.8514
25/80 [========>.....................] - ETA: 0s - loss: 0.5899 - accuracy: 0.8520
29/80 [=========>....................] - ETA: 0s - loss: 0.5858 - accuracy: 0.8534
33/80 [===========>..................] - ETA: 0s - loss: 0.5955 - accuracy: 0.8527
37/80 [============>.................] - ETA: 0s - loss: 0.5893 - accuracy: 0.8551
41/80 [==============>...............] - ETA: 0s - loss: 0.5820 - accuracy: 0.8571
45/80 [===============>..............] - ETA: 0s - loss: 0.5741 - accuracy: 0.8587
49/80 [=================>............] - ETA: 0s - loss: 0.5661 - accuracy: 0.8596
53/80 [==================>...........] - ETA: 0s - loss: 0.5656 - accuracy: 0.8592
57/80 [====================>.........] - ETA: 0s - loss: 0.5627 - accuracy: 0.8602
61/80 [=====================>........] - ETA: 0s - loss: 0.5610 - accuracy: 0.8607
65/80 [=======================>......] - ETA: 0s - loss: 0.5625 - accuracy: 0.8602
69/80 [========================>.....] - ETA: 0s - loss: 0.5598 - accuracy: 0.8616
73/80 [==========================>...] - ETA: 0s - loss: 0.5597 - accuracy: 0.8621
77/80 [===========================>..] - ETA: 0s - loss: 0.5557 - accuracy: 0.8632
80/80 [==============================] - 1s 14ms/step - loss: 0.5551 - accuracy: 0.8632

80/80 [==============================] - 1s 16ms/step - loss: 0.5551 - accuracy: 0.8632 - val_loss: 1.0183 - val_accuracy: 0.7760
Epoch 5/50

 1/80 [..............................] - ETA: 0s - loss: 0.2652 - accuracy: 0.9500
 5/80 [>.............................] - ETA: 0s - loss: 0.3695 - accuracy: 0.9040
 9/80 [==>...........................] - ETA: 0s - loss: 0.3800 - accuracy: 0.9044
13/80 [===>..........................] - ETA: 0s - loss: 0.3937 - accuracy: 0.9015
17/80 [=====>........................] - ETA: 0s - loss: 0.3965 - accuracy: 0.9024
21/80 [======>.......................] - ETA: 0s - loss: 0.4012 - accuracy: 0.9014
25/80 [========>.....................] - ETA: 0s - loss: 0.3998 - accuracy: 0.9024
29/80 [=========>....................] - ETA: 0s - loss: 0.4066 - accuracy: 0.9014
33/80 [===========>..................] - ETA: 0s - loss: 0.4097 - accuracy: 0.9003
37/80 [============>.................] - ETA: 0s - loss: 0.4062 - accuracy: 0.9008
41/80 [==============>...............] - ETA: 0s - loss: 0.4084 - accuracy: 0.8998
45/80 [===============>..............] - ETA: 0s - loss: 0.4084 - accuracy: 0.8993
49/80 [=================>............] - ETA: 0s - loss: 0.4079 - accuracy: 0.9004
53/80 [==================>...........] - ETA: 0s - loss: 0.4065 - accuracy: 0.9002
57/80 [====================>.........] - ETA: 0s - loss: 0.4085 - accuracy: 0.8991
61/80 [=====================>........] - ETA: 0s - loss: 0.4000 - accuracy: 0.9013
65/80 [=======================>......] - ETA: 0s - loss: 0.3997 - accuracy: 0.9009
69/80 [========================>.....] - ETA: 0s - loss: 0.4021 - accuracy: 0.9003
73/80 [==========================>...] - ETA: 0s - loss: 0.4035 - accuracy: 0.8996
77/80 [===========================>..] - ETA: 0s - loss: 0.4011 - accuracy: 0.9000
80/80 [==============================] - 1s 15ms/step - loss: 0.3972 - accuracy: 0.9010

80/80 [==============================] - 1s 17ms/step - loss: 0.3972 - accuracy: 0.9010 - val_loss: 1.0758 - val_accuracy: 0.7790
Epoch 6/50

 1/80 [..............................] - ETA: 0s - loss: 0.2993 - accuracy: 0.9200
 5/80 [>.............................] - ETA: 0s - loss: 0.2600 - accuracy: 0.9200
 9/80 [==>...........................] - ETA: 0s - loss: 0.2565 - accuracy: 0.9244
13/80 [===>..........................] - ETA: 0s - loss: 0.2719 - accuracy: 0.9238
17/80 [=====>........................] - ETA: 0s - loss: 0.2696 - accuracy: 0.9247
21/80 [======>.......................] - ETA: 0s - loss: 0.2801 - accuracy: 0.9219
25/80 [========>.....................] - ETA: 0s - loss: 0.2664 - accuracy: 0.9252
29/80 [=========>....................] - ETA: 0s - loss: 0.2880 - accuracy: 0.9186
33/80 [===========>..................] - ETA: 0s - loss: 0.2884 - accuracy: 0.9179
37/80 [============>.................] - ETA: 0s - loss: 0.2890 - accuracy: 0.9197
41/80 [==============>...............] - ETA: 0s - loss: 0.2865 - accuracy: 0.9202
45/80 [===============>..............] - ETA: 0s - loss: 0.2809 - accuracy: 0.9224
49/80 [=================>............] - ETA: 0s - loss: 0.2815 - accuracy: 0.9214
53/80 [==================>...........] - ETA: 0s - loss: 0.2839 - accuracy: 0.9215
57/80 [====================>.........] - ETA: 0s - loss: 0.2899 - accuracy: 0.9204
61/80 [=====================>........] - ETA: 0s - loss: 0.2850 - accuracy: 0.9216
65/80 [=======================>......] - ETA: 0s - loss: 0.2824 - accuracy: 0.9223
69/80 [========================>.....] - ETA: 0s - loss: 0.2823 - accuracy: 0.9217
73/80 [==========================>...] - ETA: 0s - loss: 0.2861 - accuracy: 0.9218
77/80 [===========================>..] - ETA: 0s - loss: 0.2914 - accuracy: 0.9209
80/80 [==============================] - 1s 15ms/step - loss: 0.2914 - accuracy: 0.9206

80/80 [==============================] - 1s 17ms/step - loss: 0.2914 - accuracy: 0.9206 - val_loss: 1.1310 - val_accuracy: 0.7850
Epoch 7/50

 1/80 [..............................] - ETA: 0s - loss: 0.2760 - accuracy: 0.9000
 5/80 [>.............................] - ETA: 0s - loss: 0.2625 - accuracy: 0.9260
 9/80 [==>...........................] - ETA: 0s - loss: 0.2329 - accuracy: 0.9367
12/80 [===>..........................] - ETA: 0s - loss: 0.2223 - accuracy: 0.9408
16/80 [=====>........................] - ETA: 0s - loss: 0.2237 - accuracy: 0.9369
19/80 [======>.......................] - ETA: 0s - loss: 0.2166 - accuracy: 0.9379
23/80 [=======>......................] - ETA: 0s - loss: 0.2268 - accuracy: 0.9343
26/80 [========>.....................] - ETA: 0s - loss: 0.2277 - accuracy: 0.9350
30/80 [==========>...................] - ETA: 0s - loss: 0.2277 - accuracy: 0.9360
34/80 [===========>..................] - ETA: 0s - loss: 0.2270 - accuracy: 0.9368
38/80 [=============>................] - ETA: 0s - loss: 0.2224 - accuracy: 0.9368
42/80 [==============>...............] - ETA: 0s - loss: 0.2130 - accuracy: 0.9398
46/80 [================>.............] - ETA: 0s - loss: 0.2157 - accuracy: 0.9389
49/80 [=================>............] - ETA: 0s - loss: 0.2174 - accuracy: 0.9382
52/80 [==================>...........] - ETA: 0s - loss: 0.2143 - accuracy: 0.9385
55/80 [===================>..........] - ETA: 0s - loss: 0.2190 - accuracy: 0.9373
58/80 [====================>.........] - ETA: 0s - loss: 0.2184 - accuracy: 0.9374
61/80 [=====================>........] - ETA: 0s - loss: 0.2160 - accuracy: 0.9377
64/80 [=======================>......] - ETA: 0s - loss: 0.2152 - accuracy: 0.9380
67/80 [========================>.....] - ETA: 0s - loss: 0.2168 - accuracy: 0.9381
71/80 [=========================>....] - ETA: 0s - loss: 0.2169 - accuracy: 0.9379
75/80 [===========================>..] - ETA: 0s - loss: 0.2140 - accuracy: 0.9392
79/80 [============================>.] - ETA: 0s - loss: 0.2158 - accuracy: 0.9385
80/80 [==============================] - 1s 17ms/step - loss: 0.2155 - accuracy: 0.9385

80/80 [==============================] - 2s 20ms/step - loss: 0.2155 - accuracy: 0.9385 - val_loss: 1.2258 - val_accuracy: 0.7810
Epoch 8/50

 1/80 [..............................] - ETA: 0s - loss: 0.1394 - accuracy: 0.9500
 4/80 [>.............................] - ETA: 1s - loss: 0.1424 - accuracy: 0.9575
 7/80 [=>............................] - ETA: 1s - loss: 0.1190 - accuracy: 0.9686
10/80 [==>...........................] - ETA: 1s - loss: 0.1228 - accuracy: 0.9660
13/80 [===>..........................] - ETA: 1s - loss: 0.1419 - accuracy: 0.9577
16/80 [=====>........................] - ETA: 1s - loss: 0.1410 - accuracy: 0.9581
19/80 [======>.......................] - ETA: 1s - loss: 0.1520 - accuracy: 0.9553
22/80 [=======>......................] - ETA: 1s - loss: 0.1513 - accuracy: 0.9555
25/80 [========>.....................] - ETA: 1s - loss: 0.1487 - accuracy: 0.9568
28/80 [=========>....................] - ETA: 0s - loss: 0.1551 - accuracy: 0.9532
31/80 [==========>...................] - ETA: 0s - loss: 0.1512 - accuracy: 0.9545
34/80 [===========>..................] - ETA: 0s - loss: 0.1546 - accuracy: 0.9541
37/80 [============>.................] - ETA: 0s - loss: 0.1547 - accuracy: 0.9543
40/80 [==============>...............] - ETA: 0s - loss: 0.1575 - accuracy: 0.9545
43/80 [===============>..............] - ETA: 0s - loss: 0.1583 - accuracy: 0.9547
46/80 [================>.............] - ETA: 0s - loss: 0.1608 - accuracy: 0.9543
49/80 [=================>............] - ETA: 0s - loss: 0.1626 - accuracy: 0.9537
52/80 [==================>...........] - ETA: 0s - loss: 0.1632 - accuracy: 0.9535
55/80 [===================>..........] - ETA: 0s - loss: 0.1634 - accuracy: 0.9527
58/80 [====================>.........] - ETA: 0s - loss: 0.1623 - accuracy: 0.9528
61/80 [=====================>........] - ETA: 0s - loss: 0.1632 - accuracy: 0.9525
64/80 [=======================>......] - ETA: 0s - loss: 0.1630 - accuracy: 0.9522
67/80 [========================>.....] - ETA: 0s - loss: 0.1655 - accuracy: 0.9515
70/80 [=========================>....] - ETA: 0s - loss: 0.1644 - accuracy: 0.9519
73/80 [==========================>...] - ETA: 0s - loss: 0.1688 - accuracy: 0.9508
76/80 [===========================>..] - ETA: 0s - loss: 0.1697 - accuracy: 0.9507
79/80 [============================>.] - ETA: 0s - loss: 0.1685 - accuracy: 0.9511
80/80 [==============================] - 2s 19ms/step - loss: 0.1678 - accuracy: 0.9513

80/80 [==============================] - 2s 23ms/step - loss: 0.1678 - accuracy: 0.9513 - val_loss: 1.2538 - val_accuracy: 0.7750
Epoch 9/50

 1/80 [..............................] - ETA: 0s - loss: 0.1218 - accuracy: 0.9500
 3/80 [>.............................] - ETA: 1s - loss: 0.1401 - accuracy: 0.9500
 6/80 [=>............................] - ETA: 1s - loss: 0.1639 - accuracy: 0.9433
 9/80 [==>...........................] - ETA: 1s - loss: 0.1391 - accuracy: 0.9533
12/80 [===>..........................] - ETA: 1s - loss: 0.1319 - accuracy: 0.9542
14/80 [====>.........................] - ETA: 1s - loss: 0.1362 - accuracy: 0.9536
16/80 [=====>........................] - ETA: 1s - loss: 0.1362 - accuracy: 0.9544
18/80 [=====>........................] - ETA: 1s - loss: 0.1386 - accuracy: 0.9539
20/80 [======>.......................] - ETA: 1s - loss: 0.1419 - accuracy: 0.9525
22/80 [=======>......................] - ETA: 1s - loss: 0.1382 - accuracy: 0.9532
24/80 [========>.....................] - ETA: 1s - loss: 0.1381 - accuracy: 0.9533
26/80 [========>.....................] - ETA: 1s - loss: 0.1370 - accuracy: 0.9531
28/80 [=========>....................] - ETA: 1s - loss: 0.1310 - accuracy: 0.9543
30/80 [==========>...................] - ETA: 1s - loss: 0.1280 - accuracy: 0.9567
32/80 [===========>..................] - ETA: 1s - loss: 0.1270 - accuracy: 0.9569
34/80 [===========>..................] - ETA: 1s - loss: 0.1237 - accuracy: 0.9582
36/80 [============>.................] - ETA: 1s - loss: 0.1255 - accuracy: 0.9581
38/80 [=============>................] - ETA: 1s - loss: 0.1235 - accuracy: 0.9582
40/80 [==============>...............] - ETA: 1s - loss: 0.1277 - accuracy: 0.9572
42/80 [==============>...............] - ETA: 1s - loss: 0.1303 - accuracy: 0.9569
44/80 [===============>..............] - ETA: 1s - loss: 0.1290 - accuracy: 0.9573
46/80 [================>.............] - ETA: 0s - loss: 0.1277 - accuracy: 0.9585
48/80 [=================>............] - ETA: 0s - loss: 0.1296 - accuracy: 0.9581
50/80 [=================>............] - ETA: 0s - loss: 0.1284 - accuracy: 0.9588
52/80 [==================>...........] - ETA: 0s - loss: 0.1296 - accuracy: 0.9579
54/80 [===================>..........] - ETA: 0s - loss: 0.1345 - accuracy: 0.9576
56/80 [====================>.........] - ETA: 0s - loss: 0.1334 - accuracy: 0.9580
58/80 [====================>.........] - ETA: 0s - loss: 0.1326 - accuracy: 0.9586
60/80 [=====================>........] - ETA: 0s - loss: 0.1320 - accuracy: 0.9588
62/80 [======================>.......] - ETA: 0s - loss: 0.1303 - accuracy: 0.9595
64/80 [=======================>......] - ETA: 0s - loss: 0.1316 - accuracy: 0.9591
66/80 [=======================>......] - ETA: 0s - loss: 0.1333 - accuracy: 0.9589
68/80 [========================>.....] - ETA: 0s - loss: 0.1340 - accuracy: 0.9587
70/80 [=========================>....] - ETA: 0s - loss: 0.1360 - accuracy: 0.9576
72/80 [==========================>...] - ETA: 0s - loss: 0.1369 - accuracy: 0.9574
74/80 [==========================>...] - ETA: 0s - loss: 0.1371 - accuracy: 0.9574
76/80 [===========================>..] - ETA: 0s - loss: 0.1364 - accuracy: 0.9574
78/80 [============================>.] - ETA: 0s - loss: 0.1399 - accuracy: 0.9568
80/80 [==============================] - 2s 30ms/step - loss: 0.1386 - accuracy: 0.9573

80/80 [==============================] - 3s 35ms/step - loss: 0.1386 - accuracy: 0.9573 - val_loss: 1.3480 - val_accuracy: 0.7830
Epoch 10/50

 1/80 [..............................] - ETA: 0s - loss: 0.0684 - accuracy: 0.9900
 3/80 [>.............................] - ETA: 1s - loss: 0.0947 - accuracy: 0.9733
 5/80 [>.............................] - ETA: 2s - loss: 0.1017 - accuracy: 0.9680
 7/80 [=>............................] - ETA: 2s - loss: 0.1144 - accuracy: 0.9629
 9/80 [==>...........................] - ETA: 2s - loss: 0.1147 - accuracy: 0.9600
11/80 [===>..........................] - ETA: 2s - loss: 0.1038 - accuracy: 0.9636
13/80 [===>..........................] - ETA: 2s - loss: 0.0973 - accuracy: 0.9669
15/80 [====>.........................] - ETA: 2s - loss: 0.0991 - accuracy: 0.9660
17/80 [=====>........................] - ETA: 2s - loss: 0.1005 - accuracy: 0.9659
19/80 [======>.......................] - ETA: 2s - loss: 0.1017 - accuracy: 0.9642
21/80 [======>.......................] - ETA: 2s - loss: 0.0977 - accuracy: 0.9652
23/80 [=======>......................] - ETA: 2s - loss: 0.1047 - accuracy: 0.9648
25/80 [========>.....................] - ETA: 2s - loss: 0.1124 - accuracy: 0.9620
27/80 [=========>....................] - ETA: 2s - loss: 0.1119 - accuracy: 0.9619
29/80 [=========>....................] - ETA: 1s - loss: 0.1108 - accuracy: 0.9614
31/80 [==========>...................] - ETA: 1s - loss: 0.1080 - accuracy: 0.9623
33/80 [===========>..................] - ETA: 1s - loss: 0.1079 - accuracy: 0.9621
35/80 [============>.................] - ETA: 1s - loss: 0.1057 - accuracy: 0.9629
37/80 [============>.................] - ETA: 1s - loss: 0.1082 - accuracy: 0.9627
39/80 [=============>................] - ETA: 1s - loss: 0.1070 - accuracy: 0.9631
41/80 [==============>...............] - ETA: 1s - loss: 0.1071 - accuracy: 0.9634
43/80 [===============>..............] - ETA: 1s - loss: 0.1051 - accuracy: 0.9640
44/80 [===============>..............] - ETA: 1s - loss: 0.1076 - accuracy: 0.9634
45/80 [===============>..............] - ETA: 1s - loss: 0.1079 - accuracy: 0.9629
47/80 [================>.............] - ETA: 1s - loss: 0.1114 - accuracy: 0.9619
49/80 [=================>............] - ETA: 1s - loss: 0.1129 - accuracy: 0.9612
51/80 [==================>...........] - ETA: 1s - loss: 0.1142 - accuracy: 0.9612
53/80 [==================>...........] - ETA: 1s - loss: 0.1179 - accuracy: 0.9600
55/80 [===================>..........] - ETA: 0s - loss: 0.1194 - accuracy: 0.9595
57/80 [====================>.........] - ETA: 0s - loss: 0.1200 - accuracy: 0.9595
59/80 [=====================>........] - ETA: 0s - loss: 0.1203 - accuracy: 0.9595
61/80 [=====================>........] - ETA: 0s - loss: 0.1216 - accuracy: 0.9593
63/80 [======================>.......] - ETA: 0s - loss: 0.1228 - accuracy: 0.9590
65/80 [=======================>......] - ETA: 0s - loss: 0.1231 - accuracy: 0.9591
67/80 [========================>.....] - ETA: 0s - loss: 0.1221 - accuracy: 0.9596
69/80 [========================>.....] - ETA: 0s - loss: 0.1220 - accuracy: 0.9597
71/80 [=========================>....] - ETA: 0s - loss: 0.1233 - accuracy: 0.9592
73/80 [==========================>...] - ETA: 0s - loss: 0.1234 - accuracy: 0.9593
75/80 [===========================>..] - ETA: 0s - loss: 0.1238 - accuracy: 0.9591
77/80 [===========================>..] - ETA: 0s - loss: 0.1236 - accuracy: 0.9592
79/80 [============================>.] - ETA: 0s - loss: 0.1254 - accuracy: 0.9582
80/80 [==============================] - 3s 37ms/step - loss: 0.1268 - accuracy: 0.9578

80/80 [==============================] - 3s 42ms/step - loss: 0.1268 - accuracy: 0.9578 - val_loss: 1.4505 - val_accuracy: 0.7960
Epoch 11/50

 1/80 [..............................] - ETA: 0s - loss: 0.1156 - accuracy: 0.9700
 3/80 [>.............................] - ETA: 1s - loss: 0.1025 - accuracy: 0.9767
 5/80 [>.............................] - ETA: 1s - loss: 0.0863 - accuracy: 0.9800
 7/80 [=>............................] - ETA: 2s - loss: 0.0936 - accuracy: 0.9686
 9/80 [==>...........................] - ETA: 2s - loss: 0.0884 - accuracy: 0.9689
11/80 [===>..........................] - ETA: 2s - loss: 0.0991 - accuracy: 0.9636
13/80 [===>..........................] - ETA: 2s - loss: 0.0985 - accuracy: 0.9654
15/80 [====>.........................] - ETA: 2s - loss: 0.1051 - accuracy: 0.9627
17/80 [=====>........................] - ETA: 1s - loss: 0.1063 - accuracy: 0.9594
19/80 [======>.......................] - ETA: 1s - loss: 0.1026 - accuracy: 0.9605
21/80 [======>.......................] - ETA: 1s - loss: 0.1107 - accuracy: 0.9586
23/80 [=======>......................] - ETA: 1s - loss: 0.1076 - accuracy: 0.9591
25/80 [========>.....................] - ETA: 1s - loss: 0.1116 - accuracy: 0.9580
27/80 [=========>....................] - ETA: 1s - loss: 0.1116 - accuracy: 0.9585
29/80 [=========>....................] - ETA: 1s - loss: 0.1125 - accuracy: 0.9579
31/80 [==========>...................] - ETA: 1s - loss: 0.1111 - accuracy: 0.9581
33/80 [===========>..................] - ETA: 1s - loss: 0.1106 - accuracy: 0.9585
35/80 [============>.................] - ETA: 1s - loss: 0.1148 - accuracy: 0.9580
37/80 [============>.................] - ETA: 1s - loss: 0.1130 - accuracy: 0.9589
39/80 [=============>................] - ETA: 1s - loss: 0.1118 - accuracy: 0.9592
41/80 [==============>...............] - ETA: 1s - loss: 0.1131 - accuracy: 0.9590
43/80 [===============>..............] - ETA: 1s - loss: 0.1129 - accuracy: 0.9591
45/80 [===============>..............] - ETA: 1s - loss: 0.1138 - accuracy: 0.9589
47/80 [================>.............] - ETA: 1s - loss: 0.1113 - accuracy: 0.9591
49/80 [=================>............] - ETA: 1s - loss: 0.1112 - accuracy: 0.9592
51/80 [==================>...........] - ETA: 0s - loss: 0.1122 - accuracy: 0.9586
53/80 [==================>...........] - ETA: 0s - loss: 0.1112 - accuracy: 0.9587
55/80 [===================>..........] - ETA: 0s - loss: 0.1110 - accuracy: 0.9585
57/80 [====================>.........] - ETA: 0s - loss: 0.1115 - accuracy: 0.9581
59/80 [=====================>........] - ETA: 0s - loss: 0.1111 - accuracy: 0.9580
61/80 [=====================>........] - ETA: 0s - loss: 0.1100 - accuracy: 0.9584
63/80 [======================>.......] - ETA: 0s - loss: 0.1110 - accuracy: 0.9583
65/80 [=======================>......] - ETA: 0s - loss: 0.1109 - accuracy: 0.9582
67/80 [========================>.....] - ETA: 0s - loss: 0.1130 - accuracy: 0.9576
69/80 [========================>.....] - ETA: 0s - loss: 0.1143 - accuracy: 0.9571
71/80 [=========================>....] - ETA: 0s - loss: 0.1146 - accuracy: 0.9569
73/80 [==========================>...] - ETA: 0s - loss: 0.1154 - accuracy: 0.9567
75/80 [===========================>..] - ETA: 0s - loss: 0.1155 - accuracy: 0.9568
77/80 [===========================>..] - ETA: 0s - loss: 0.1156 - accuracy: 0.9566
79/80 [============================>.] - ETA: 0s - loss: 0.1140 - accuracy: 0.9575
80/80 [==============================] - 3s 34ms/step - loss: 0.1140 - accuracy: 0.9574

80/80 [==============================] - 3s 39ms/step - loss: 0.1140 - accuracy: 0.9574 - val_loss: 1.3306 - val_accuracy: 0.7840
Epoch 12/50

 1/80 [..............................] - ETA: 0s - loss: 0.1638 - accuracy: 0.9600
 3/80 [>.............................] - ETA: 1s - loss: 0.1079 - accuracy: 0.9733
 5/80 [>.............................] - ETA: 2s - loss: 0.1060 - accuracy: 0.9660
 7/80 [=>............................] - ETA: 2s - loss: 0.1030 - accuracy: 0.9671
 9/80 [==>...........................] - ETA: 2s - loss: 0.1088 - accuracy: 0.9656
11/80 [===>..........................] - ETA: 2s - loss: 0.1047 - accuracy: 0.9636
13/80 [===>..........................] - ETA: 2s - loss: 0.1030 - accuracy: 0.9638
15/80 [====>.........................] - ETA: 2s - loss: 0.0987 - accuracy: 0.9640
17/80 [=====>........................] - ETA: 2s - loss: 0.0922 - accuracy: 0.9653
19/80 [======>.......................] - ETA: 1s - loss: 0.0982 - accuracy: 0.9626
21/80 [======>.......................] - ETA: 1s - loss: 0.1018 - accuracy: 0.9600
23/80 [=======>......................] - ETA: 1s - loss: 0.0993 - accuracy: 0.9613
25/80 [========>.....................] - ETA: 1s - loss: 0.0961 - accuracy: 0.9632
27/80 [=========>....................] - ETA: 1s - loss: 0.1010 - accuracy: 0.9611
29/80 [=========>....................] - ETA: 1s - loss: 0.0997 - accuracy: 0.9614
31/80 [==========>...................] - ETA: 1s - loss: 0.0992 - accuracy: 0.9616
33/80 [===========>..................] - ETA: 1s - loss: 0.1059 - accuracy: 0.9600
35/80 [============>.................] - ETA: 1s - loss: 0.1034 - accuracy: 0.9609
37/80 [============>.................] - ETA: 1s - loss: 0.1030 - accuracy: 0.9614
39/80 [=============>................] - ETA: 1s - loss: 0.1040 - accuracy: 0.9605
41/80 [==============>...............] - ETA: 1s - loss: 0.1018 - accuracy: 0.9607
43/80 [===============>..............] - ETA: 1s - loss: 0.1014 - accuracy: 0.9609
45/80 [===============>..............] - ETA: 1s - loss: 0.0985 - accuracy: 0.9618
47/80 [================>.............] - ETA: 1s - loss: 0.1014 - accuracy: 0.9613
49/80 [=================>............] - ETA: 1s - loss: 0.1028 - accuracy: 0.9606
51/80 [==================>...........] - ETA: 0s - loss: 0.1031 - accuracy: 0.9608
53/80 [==================>...........] - ETA: 0s - loss: 0.1040 - accuracy: 0.9606
55/80 [===================>..........] - ETA: 0s - loss: 0.1060 - accuracy: 0.9602
57/80 [====================>.........] - ETA: 0s - loss: 0.1049 - accuracy: 0.9602
59/80 [=====================>........] - ETA: 0s - loss: 0.1048 - accuracy: 0.9602
61/80 [=====================>........] - ETA: 0s - loss: 0.1045 - accuracy: 0.9600
63/80 [======================>.......] - ETA: 0s - loss: 0.1056 - accuracy: 0.9597
65/80 [=======================>......] - ETA: 0s - loss: 0.1046 - accuracy: 0.9602
67/80 [========================>.....] - ETA: 0s - loss: 0.1039 - accuracy: 0.9606
69/80 [========================>.....] - ETA: 0s - loss: 0.1044 - accuracy: 0.9600
71/80 [=========================>....] - ETA: 0s - loss: 0.1033 - accuracy: 0.9603
73/80 [==========================>...] - ETA: 0s - loss: 0.1037 - accuracy: 0.9599
75/80 [===========================>..] - ETA: 0s - loss: 0.1038 - accuracy: 0.9592
77/80 [===========================>..] - ETA: 0s - loss: 0.1033 - accuracy: 0.9592
79/80 [============================>.] - ETA: 0s - loss: 0.1045 - accuracy: 0.9590
80/80 [==============================] - 3s 31ms/step - loss: 0.1045 - accuracy: 0.9589

80/80 [==============================] - 3s 35ms/step - loss: 0.1045 - accuracy: 0.9589 - val_loss: 1.4464 - val_accuracy: 0.7820
Epoch 13/50

 1/80 [..............................] - ETA: 0s - loss: 0.0672 - accuracy: 0.9600
 3/80 [>.............................] - ETA: 1s - loss: 0.1124 - accuracy: 0.9500
 6/80 [=>............................] - ETA: 1s - loss: 0.0955 - accuracy: 0.9600
 9/80 [==>...........................] - ETA: 1s - loss: 0.0790 - accuracy: 0.9678
12/80 [===>..........................] - ETA: 1s - loss: 0.0841 - accuracy: 0.9700
15/80 [====>.........................] - ETA: 1s - loss: 0.0913 - accuracy: 0.9680
18/80 [=====>........................] - ETA: 1s - loss: 0.0876 - accuracy: 0.9683
20/80 [======>.......................] - ETA: 1s - loss: 0.0845 - accuracy: 0.9695
22/80 [=======>......................] - ETA: 1s - loss: 0.0849 - accuracy: 0.9705
24/80 [========>.....................] - ETA: 1s - loss: 0.0891 - accuracy: 0.9683
27/80 [=========>....................] - ETA: 1s - loss: 0.0978 - accuracy: 0.9656
30/80 [==========>...................] - ETA: 1s - loss: 0.0980 - accuracy: 0.9650
33/80 [===========>..................] - ETA: 1s - loss: 0.0965 - accuracy: 0.9661
36/80 [============>.................] - ETA: 1s - loss: 0.1003 - accuracy: 0.9639
39/80 [=============>................] - ETA: 0s - loss: 0.0970 - accuracy: 0.9649
41/80 [==============>...............] - ETA: 0s - loss: 0.0961 - accuracy: 0.9654
44/80 [===============>..............] - ETA: 0s - loss: 0.0981 - accuracy: 0.9643
47/80 [================>.............] - ETA: 0s - loss: 0.0996 - accuracy: 0.9643
50/80 [=================>............] - ETA: 0s - loss: 0.0993 - accuracy: 0.9638
53/80 [==================>...........] - ETA: 0s - loss: 0.1009 - accuracy: 0.9630
56/80 [====================>.........] - ETA: 0s - loss: 0.0995 - accuracy: 0.9634
59/80 [=====================>........] - ETA: 0s - loss: 0.1001 - accuracy: 0.9631
62/80 [======================>.......] - ETA: 0s - loss: 0.1004 - accuracy: 0.9627
65/80 [=======================>......] - ETA: 0s - loss: 0.0999 - accuracy: 0.9628
68/80 [========================>.....] - ETA: 0s - loss: 0.1009 - accuracy: 0.9625
71/80 [=========================>....] - ETA: 0s - loss: 0.1025 - accuracy: 0.9618
74/80 [==========================>...] - ETA: 0s - loss: 0.1029 - accuracy: 0.9616
77/80 [===========================>..] - ETA: 0s - loss: 0.1028 - accuracy: 0.9618
80/80 [==============================] - 2s 23ms/step - loss: 0.1028 - accuracy: 0.9614

80/80 [==============================] - 2s 26ms/step - loss: 0.1028 - accuracy: 0.9614 - val_loss: 1.4638 - val_accuracy: 0.7870
Epoch 14/50

 1/80 [..............................] - ETA: 0s - loss: 0.0952 - accuracy: 0.9600
 4/80 [>.............................] - ETA: 1s - loss: 0.0599 - accuracy: 0.9750
 7/80 [=>............................] - ETA: 1s - loss: 0.0758 - accuracy: 0.9729
10/80 [==>...........................] - ETA: 1s - loss: 0.0958 - accuracy: 0.9630
13/80 [===>..........................] - ETA: 1s - loss: 0.0834 - accuracy: 0.9677
16/80 [=====>........................] - ETA: 1s - loss: 0.0954 - accuracy: 0.9656
19/80 [======>.......................] - ETA: 1s - loss: 0.0954 - accuracy: 0.9642
22/80 [=======>......................] - ETA: 1s - loss: 0.0953 - accuracy: 0.9632
25/80 [========>.....................] - ETA: 1s - loss: 0.0983 - accuracy: 0.9608
28/80 [=========>....................] - ETA: 0s - loss: 0.1079 - accuracy: 0.9579
31/80 [==========>...................] - ETA: 0s - loss: 0.1030 - accuracy: 0.9600
34/80 [===========>..................] - ETA: 0s - loss: 0.0997 - accuracy: 0.9615
37/80 [============>.................] - ETA: 0s - loss: 0.1020 - accuracy: 0.9608
40/80 [==============>...............] - ETA: 0s - loss: 0.1001 - accuracy: 0.9613
43/80 [===============>..............] - ETA: 0s - loss: 0.1017 - accuracy: 0.9595
46/80 [================>.............] - ETA: 0s - loss: 0.0999 - accuracy: 0.9600
49/80 [=================>............] - ETA: 0s - loss: 0.1005 - accuracy: 0.9598
52/80 [==================>...........] - ETA: 0s - loss: 0.1022 - accuracy: 0.9590
55/80 [===================>..........] - ETA: 0s - loss: 0.1028 - accuracy: 0.9584
58/80 [====================>.........] - ETA: 0s - loss: 0.1017 - accuracy: 0.9588
61/80 [=====================>........] - ETA: 0s - loss: 0.1008 - accuracy: 0.9597
64/80 [=======================>......] - ETA: 0s - loss: 0.0994 - accuracy: 0.9603
67/80 [========================>.....] - ETA: 0s - loss: 0.0993 - accuracy: 0.9599
70/80 [=========================>....] - ETA: 0s - loss: 0.0989 - accuracy: 0.9603
73/80 [==========================>...] - ETA: 0s - loss: 0.1010 - accuracy: 0.9592
76/80 [===========================>..] - ETA: 0s - loss: 0.1010 - accuracy: 0.9591
79/80 [============================>.] - ETA: 0s - loss: 0.1004 - accuracy: 0.9592
80/80 [==============================] - 2s 19ms/step - loss: 0.1002 - accuracy: 0.9592

80/80 [==============================] - 2s 22ms/step - loss: 0.1002 - accuracy: 0.9592 - val_loss: 1.4595 - val_accuracy: 0.7860
Epoch 15/50

 1/80 [..............................] - ETA: 0s - loss: 0.0622 - accuracy: 0.9700
 4/80 [>.............................] - ETA: 0s - loss: 0.0604 - accuracy: 0.9775
 8/80 [==>...........................] - ETA: 1s - loss: 0.0745 - accuracy: 0.9688
12/80 [===>..........................] - ETA: 1s - loss: 0.0707 - accuracy: 0.9717
15/80 [====>.........................] - ETA: 1s - loss: 0.0624 - accuracy: 0.9747
18/80 [=====>........................] - ETA: 0s - loss: 0.0752 - accuracy: 0.9700
21/80 [======>.......................] - ETA: 0s - loss: 0.0831 - accuracy: 0.9690
24/80 [========>.....................] - ETA: 0s - loss: 0.0852 - accuracy: 0.9671
27/80 [=========>....................] - ETA: 0s - loss: 0.0875 - accuracy: 0.9656
30/80 [==========>...................] - ETA: 0s - loss: 0.0855 - accuracy: 0.9663
33/80 [===========>..................] - ETA: 0s - loss: 0.0843 - accuracy: 0.9673
36/80 [============>.................] - ETA: 0s - loss: 0.0857 - accuracy: 0.9672
39/80 [=============>................] - ETA: 0s - loss: 0.0858 - accuracy: 0.9656
42/80 [==============>...............] - ETA: 0s - loss: 0.0897 - accuracy: 0.9643
45/80 [===============>..............] - ETA: 0s - loss: 0.0890 - accuracy: 0.9638
48/80 [=================>............] - ETA: 0s - loss: 0.0903 - accuracy: 0.9638
52/80 [==================>...........] - ETA: 0s - loss: 0.0895 - accuracy: 0.9637
55/80 [===================>..........] - ETA: 0s - loss: 0.0899 - accuracy: 0.9633
58/80 [====================>.........] - ETA: 0s - loss: 0.0894 - accuracy: 0.9631
61/80 [=====================>........] - ETA: 0s - loss: 0.0912 - accuracy: 0.9625
64/80 [=======================>......] - ETA: 0s - loss: 0.0926 - accuracy: 0.9623
67/80 [========================>.....] - ETA: 0s - loss: 0.0930 - accuracy: 0.9621
70/80 [=========================>....] - ETA: 0s - loss: 0.0955 - accuracy: 0.9614
74/80 [==========================>...] - ETA: 0s - loss: 0.0945 - accuracy: 0.9616
77/80 [===========================>..] - ETA: 0s - loss: 0.0942 - accuracy: 0.9614
80/80 [==============================] - 1s 17ms/step - loss: 0.0963 - accuracy: 0.9602

80/80 [==============================] - 2s 20ms/step - loss: 0.0963 - accuracy: 0.9602 - val_loss: 1.5206 - val_accuracy: 0.7880
Epoch 16/50

 1/80 [..............................] - ETA: 0s - loss: 0.0446 - accuracy: 0.9900
 5/80 [>.............................] - ETA: 0s - loss: 0.0457 - accuracy: 0.9800
 9/80 [==>...........................] - ETA: 0s - loss: 0.0603 - accuracy: 0.9744
13/80 [===>..........................] - ETA: 0s - loss: 0.0701 - accuracy: 0.9723
16/80 [=====>........................] - ETA: 0s - loss: 0.0783 - accuracy: 0.9712
19/80 [======>.......................] - ETA: 0s - loss: 0.0816 - accuracy: 0.9684
23/80 [=======>......................] - ETA: 0s - loss: 0.0816 - accuracy: 0.9678
27/80 [=========>....................] - ETA: 0s - loss: 0.0811 - accuracy: 0.9681
31/80 [==========>...................] - ETA: 0s - loss: 0.0807 - accuracy: 0.9687
35/80 [============>.................] - ETA: 0s - loss: 0.0836 - accuracy: 0.9663
39/80 [=============>................] - ETA: 0s - loss: 0.0828 - accuracy: 0.9649
43/80 [===============>..............] - ETA: 0s - loss: 0.0828 - accuracy: 0.9649
47/80 [================>.............] - ETA: 0s - loss: 0.0825 - accuracy: 0.9647
51/80 [==================>...........] - ETA: 0s - loss: 0.0840 - accuracy: 0.9635
54/80 [===================>..........] - ETA: 0s - loss: 0.0830 - accuracy: 0.9641
57/80 [====================>.........] - ETA: 0s - loss: 0.0835 - accuracy: 0.9639
61/80 [=====================>........] - ETA: 0s - loss: 0.0832 - accuracy: 0.9644
65/80 [=======================>......] - ETA: 0s - loss: 0.0807 - accuracy: 0.9651
69/80 [========================>.....] - ETA: 0s - loss: 0.0800 - accuracy: 0.9652
73/80 [==========================>...] - ETA: 0s - loss: 0.0815 - accuracy: 0.9645
77/80 [===========================>..] - ETA: 0s - loss: 0.0845 - accuracy: 0.9635
80/80 [==============================] - 1s 16ms/step - loss: 0.0864 - accuracy: 0.9624

80/80 [==============================] - 1s 18ms/step - loss: 0.0864 - accuracy: 0.9624 - val_loss: 1.5680 - val_accuracy: 0.7830
Epoch 17/50

 1/80 [..............................] - ETA: 0s - loss: 0.1327 - accuracy: 0.9500
 5/80 [>.............................] - ETA: 0s - loss: 0.0644 - accuracy: 0.9740
 9/80 [==>...........................] - ETA: 0s - loss: 0.0667 - accuracy: 0.9744
13/80 [===>..........................] - ETA: 0s - loss: 0.0775 - accuracy: 0.9677
17/80 [=====>........................] - ETA: 0s - loss: 0.0847 - accuracy: 0.9635
21/80 [======>.......................] - ETA: 0s - loss: 0.0870 - accuracy: 0.9614
25/80 [========>.....................] - ETA: 0s - loss: 0.0836 - accuracy: 0.9644
29/80 [=========>....................] - ETA: 0s - loss: 0.0877 - accuracy: 0.9634
33/80 [===========>..................] - ETA: 0s - loss: 0.0885 - accuracy: 0.9618
37/80 [============>.................] - ETA: 0s - loss: 0.0852 - accuracy: 0.9638
41/80 [==============>...............] - ETA: 0s - loss: 0.0837 - accuracy: 0.9644
45/80 [===============>..............] - ETA: 0s - loss: 0.0836 - accuracy: 0.9638
49/80 [=================>............] - ETA: 0s - loss: 0.0841 - accuracy: 0.9635
53/80 [==================>...........] - ETA: 0s - loss: 0.0867 - accuracy: 0.9632
57/80 [====================>.........] - ETA: 0s - loss: 0.0861 - accuracy: 0.9635
61/80 [=====================>........] - ETA: 0s - loss: 0.0874 - accuracy: 0.9631
65/80 [=======================>......] - ETA: 0s - loss: 0.0882 - accuracy: 0.9626
69/80 [========================>.....] - ETA: 0s - loss: 0.0888 - accuracy: 0.9619
73/80 [==========================>...] - ETA: 0s - loss: 0.0872 - accuracy: 0.9622
77/80 [===========================>..] - ETA: 0s - loss: 0.0883 - accuracy: 0.9614
80/80 [==============================] - 1s 15ms/step - loss: 0.0873 - accuracy: 0.9617

80/80 [==============================] - 1s 17ms/step - loss: 0.0873 - accuracy: 0.9617 - val_loss: 1.6131 - val_accuracy: 0.7880
Epoch 18/50

 1/80 [..............................] - ETA: 0s - loss: 0.0542 - accuracy: 0.9600
 5/80 [>.............................] - ETA: 0s - loss: 0.0727 - accuracy: 0.9640
 9/80 [==>...........................] - ETA: 0s - loss: 0.0759 - accuracy: 0.9622
13/80 [===>..........................] - ETA: 0s - loss: 0.0669 - accuracy: 0.9669
17/80 [=====>........................] - ETA: 0s - loss: 0.0747 - accuracy: 0.9635
21/80 [======>.......................] - ETA: 0s - loss: 0.0732 - accuracy: 0.9638
25/80 [========>.....................] - ETA: 0s - loss: 0.0725 - accuracy: 0.9636
29/80 [=========>....................] - ETA: 0s - loss: 0.0751 - accuracy: 0.9621
33/80 [===========>..................] - ETA: 0s - loss: 0.0756 - accuracy: 0.9621
37/80 [============>.................] - ETA: 0s - loss: 0.0790 - accuracy: 0.9616
41/80 [==============>...............] - ETA: 0s - loss: 0.0772 - accuracy: 0.9624
45/80 [===============>..............] - ETA: 0s - loss: 0.0788 - accuracy: 0.9631
49/80 [=================>............] - ETA: 0s - loss: 0.0797 - accuracy: 0.9629
53/80 [==================>...........] - ETA: 0s - loss: 0.0799 - accuracy: 0.9634
57/80 [====================>.........] - ETA: 0s - loss: 0.0822 - accuracy: 0.9630
61/80 [=====================>........] - ETA: 0s - loss: 0.0838 - accuracy: 0.9621
65/80 [=======================>......] - ETA: 0s - loss: 0.0849 - accuracy: 0.9617
69/80 [========================>.....] - ETA: 0s - loss: 0.0846 - accuracy: 0.9619
73/80 [==========================>...] - ETA: 0s - loss: 0.0850 - accuracy: 0.9618
77/80 [===========================>..] - ETA: 0s - loss: 0.0877 - accuracy: 0.9603
80/80 [==============================] - 1s 15ms/step - loss: 0.0870 - accuracy: 0.9605

80/80 [==============================] - 1s 17ms/step - loss: 0.0870 - accuracy: 0.9605 - val_loss: 1.5909 - val_accuracy: 0.7860
Epoch 19/50

 1/80 [..............................] - ETA: 0s - loss: 0.0619 - accuracy: 0.9600
 5/80 [>.............................] - ETA: 0s - loss: 0.0801 - accuracy: 0.9700
 9/80 [==>...........................] - ETA: 0s - loss: 0.0693 - accuracy: 0.9733
13/80 [===>..........................] - ETA: 0s - loss: 0.0713 - accuracy: 0.9731
17/80 [=====>........................] - ETA: 0s - loss: 0.0723 - accuracy: 0.9712
21/80 [======>.......................] - ETA: 0s - loss: 0.0748 - accuracy: 0.9690
25/80 [========>.....................] - ETA: 0s - loss: 0.0741 - accuracy: 0.9696
29/80 [=========>....................] - ETA: 0s - loss: 0.0744 - accuracy: 0.9700
33/80 [===========>..................] - ETA: 0s - loss: 0.0768 - accuracy: 0.9688
37/80 [============>.................] - ETA: 0s - loss: 0.0774 - accuracy: 0.9681
41/80 [==============>...............] - ETA: 0s - loss: 0.0788 - accuracy: 0.9668
45/80 [===============>..............] - ETA: 0s - loss: 0.0802 - accuracy: 0.9664
49/80 [=================>............] - ETA: 0s - loss: 0.0785 - accuracy: 0.9667
53/80 [==================>...........] - ETA: 0s - loss: 0.0780 - accuracy: 0.9670
57/80 [====================>.........] - ETA: 0s - loss: 0.0811 - accuracy: 0.9654
61/80 [=====================>........] - ETA: 0s - loss: 0.0823 - accuracy: 0.9649
65/80 [=======================>......] - ETA: 0s - loss: 0.0819 - accuracy: 0.9646
69/80 [========================>.....] - ETA: 0s - loss: 0.0818 - accuracy: 0.9649
73/80 [==========================>...] - ETA: 0s - loss: 0.0830 - accuracy: 0.9648
77/80 [===========================>..] - ETA: 0s - loss: 0.0814 - accuracy: 0.9647
80/80 [==============================] - 1s 15ms/step - loss: 0.0826 - accuracy: 0.9638

80/80 [==============================] - 1s 18ms/step - loss: 0.0826 - accuracy: 0.9638 - val_loss: 1.5883 - val_accuracy: 0.7820
Epoch 20/50

 1/80 [..............................] - ETA: 0s - loss: 0.0338 - accuracy: 0.9900
 5/80 [>.............................] - ETA: 0s - loss: 0.0704 - accuracy: 0.9700
 9/80 [==>...........................] - ETA: 0s - loss: 0.0658 - accuracy: 0.9711
13/80 [===>..........................] - ETA: 0s - loss: 0.0760 - accuracy: 0.9677
17/80 [=====>........................] - ETA: 0s - loss: 0.0745 - accuracy: 0.9665
21/80 [======>.......................] - ETA: 0s - loss: 0.0690 - accuracy: 0.9686
25/80 [========>.....................] - ETA: 0s - loss: 0.0723 - accuracy: 0.9680
29/80 [=========>....................] - ETA: 0s - loss: 0.0784 - accuracy: 0.9641
33/80 [===========>..................] - ETA: 0s - loss: 0.0770 - accuracy: 0.9648
37/80 [============>.................] - ETA: 0s - loss: 0.0746 - accuracy: 0.9651
41/80 [==============>...............] - ETA: 0s - loss: 0.0748 - accuracy: 0.9656
45/80 [===============>..............] - ETA: 0s - loss: 0.0759 - accuracy: 0.9653
49/80 [=================>............] - ETA: 0s - loss: 0.0769 - accuracy: 0.9645
53/80 [==================>...........] - ETA: 0s - loss: 0.0792 - accuracy: 0.9634
57/80 [====================>.........] - ETA: 0s - loss: 0.0777 - accuracy: 0.9642
61/80 [=====================>........] - ETA: 0s - loss: 0.0800 - accuracy: 0.9634
65/80 [=======================>......] - ETA: 0s - loss: 0.0805 - accuracy: 0.9634
69/80 [========================>.....] - ETA: 0s - loss: 0.0820 - accuracy: 0.9632
73/80 [==========================>...] - ETA: 0s - loss: 0.0828 - accuracy: 0.9627
77/80 [===========================>..] - ETA: 0s - loss: 0.0828 - accuracy: 0.9625
80/80 [==============================] - 1s 15ms/step - loss: 0.0831 - accuracy: 0.9625

80/80 [==============================] - 1s 17ms/step - loss: 0.0831 - accuracy: 0.9625 - val_loss: 1.5332 - val_accuracy: 0.7840
Epoch 21/50

 1/80 [..............................] - ETA: 0s - loss: 0.0440 - accuracy: 0.9800
 5/80 [>.............................] - ETA: 0s - loss: 0.0454 - accuracy: 0.9740
 9/80 [==>...........................] - ETA: 0s - loss: 0.0508 - accuracy: 0.9744
13/80 [===>..........................] - ETA: 0s - loss: 0.0603 - accuracy: 0.9700
17/80 [=====>........................] - ETA: 0s - loss: 0.0644 - accuracy: 0.9682
21/80 [======>.......................] - ETA: 0s - loss: 0.0685 - accuracy: 0.9657
25/80 [========>.....................] - ETA: 0s - loss: 0.0715 - accuracy: 0.9656
29/80 [=========>....................] - ETA: 0s - loss: 0.0745 - accuracy: 0.9631
33/80 [===========>..................] - ETA: 0s - loss: 0.0752 - accuracy: 0.9627
37/80 [============>.................] - ETA: 0s - loss: 0.0797 - accuracy: 0.9600
41/80 [==============>...............] - ETA: 0s - loss: 0.0778 - accuracy: 0.9600
45/80 [===============>..............] - ETA: 0s - loss: 0.0772 - accuracy: 0.9593
49/80 [=================>............] - ETA: 0s - loss: 0.0764 - accuracy: 0.9600
53/80 [==================>...........] - ETA: 0s - loss: 0.0775 - accuracy: 0.9592
57/80 [====================>.........] - ETA: 0s - loss: 0.0785 - accuracy: 0.9593
61/80 [=====================>........] - ETA: 0s - loss: 0.0785 - accuracy: 0.9589
65/80 [=======================>......] - ETA: 0s - loss: 0.0794 - accuracy: 0.9585
69/80 [========================>.....] - ETA: 0s - loss: 0.0800 - accuracy: 0.9583
73/80 [==========================>...] - ETA: 0s - loss: 0.0796 - accuracy: 0.9585
77/80 [===========================>..] - ETA: 0s - loss: 0.0787 - accuracy: 0.9587
80/80 [==============================] - 1s 15ms/step - loss: 0.0781 - accuracy: 0.9589

80/80 [==============================] - 1s 18ms/step - loss: 0.0781 - accuracy: 0.9589 - val_loss: 1.5888 - val_accuracy: 0.7820
Epoch 22/50

 1/80 [..............................] - ETA: 0s - loss: 0.1075 - accuracy: 0.9400
 5/80 [>.............................] - ETA: 0s - loss: 0.0741 - accuracy: 0.9580
 9/80 [==>...........................] - ETA: 1s - loss: 0.0730 - accuracy: 0.9567
13/80 [===>..........................] - ETA: 0s - loss: 0.0709 - accuracy: 0.9623
17/80 [=====>........................] - ETA: 0s - loss: 0.0825 - accuracy: 0.9588
21/80 [======>.......................] - ETA: 0s - loss: 0.0791 - accuracy: 0.9595
25/80 [========>.....................] - ETA: 0s - loss: 0.0770 - accuracy: 0.9616
29/80 [=========>....................] - ETA: 0s - loss: 0.0758 - accuracy: 0.9621
33/80 [===========>..................] - ETA: 0s - loss: 0.0739 - accuracy: 0.9630
37/80 [============>.................] - ETA: 0s - loss: 0.0744 - accuracy: 0.9627
41/80 [==============>...............] - ETA: 0s - loss: 0.0731 - accuracy: 0.9634
44/80 [===============>..............] - ETA: 0s - loss: 0.0755 - accuracy: 0.9625
47/80 [================>.............] - ETA: 0s - loss: 0.0727 - accuracy: 0.9634
51/80 [==================>...........] - ETA: 0s - loss: 0.0735 - accuracy: 0.9629
54/80 [===================>..........] - ETA: 0s - loss: 0.0744 - accuracy: 0.9619
57/80 [====================>.........] - ETA: 0s - loss: 0.0739 - accuracy: 0.9625
61/80 [=====================>........] - ETA: 0s - loss: 0.0736 - accuracy: 0.9623
65/80 [=======================>......] - ETA: 0s - loss: 0.0736 - accuracy: 0.9620
68/80 [========================>.....] - ETA: 0s - loss: 0.0735 - accuracy: 0.9624
71/80 [=========================>....] - ETA: 0s - loss: 0.0740 - accuracy: 0.9623
75/80 [===========================>..] - ETA: 0s - loss: 0.0746 - accuracy: 0.9621
79/80 [============================>.] - ETA: 0s - loss: 0.0775 - accuracy: 0.9610
80/80 [==============================] - 1s 16ms/step - loss: 0.0775 - accuracy: 0.9610

80/80 [==============================] - 1s 18ms/step - loss: 0.0775 - accuracy: 0.9610 - val_loss: 1.6816 - val_accuracy: 0.7860
Epoch 23/50

 1/80 [..............................] - ETA: 0s - loss: 0.1126 - accuracy: 0.9400
 4/80 [>.............................] - ETA: 0s - loss: 0.0613 - accuracy: 0.9775
 8/80 [==>...........................] - ETA: 1s - loss: 0.0836 - accuracy: 0.9638
12/80 [===>..........................] - ETA: 1s - loss: 0.0778 - accuracy: 0.9650
16/80 [=====>........................] - ETA: 0s - loss: 0.0768 - accuracy: 0.9644
20/80 [======>.......................] - ETA: 0s - loss: 0.0738 - accuracy: 0.9645
24/80 [========>.....................] - ETA: 0s - loss: 0.0753 - accuracy: 0.9621
28/80 [=========>....................] - ETA: 0s - loss: 0.0760 - accuracy: 0.9618
32/80 [===========>..................] - ETA: 0s - loss: 0.0739 - accuracy: 0.9625
36/80 [============>.................] - ETA: 0s - loss: 0.0721 - accuracy: 0.9633
40/80 [==============>...............] - ETA: 0s - loss: 0.0748 - accuracy: 0.9617
43/80 [===============>..............] - ETA: 0s - loss: 0.0754 - accuracy: 0.9614
47/80 [================>.............] - ETA: 0s - loss: 0.0750 - accuracy: 0.9609
51/80 [==================>...........] - ETA: 0s - loss: 0.0742 - accuracy: 0.9616
55/80 [===================>..........] - ETA: 0s - loss: 0.0749 - accuracy: 0.9611
59/80 [=====================>........] - ETA: 0s - loss: 0.0739 - accuracy: 0.9617
63/80 [======================>.......] - ETA: 0s - loss: 0.0738 - accuracy: 0.9613
67/80 [========================>.....] - ETA: 0s - loss: 0.0735 - accuracy: 0.9616
70/80 [=========================>....] - ETA: 0s - loss: 0.0741 - accuracy: 0.9610
73/80 [==========================>...] - ETA: 0s - loss: 0.0757 - accuracy: 0.9601
76/80 [===========================>..] - ETA: 0s - loss: 0.0757 - accuracy: 0.9599
79/80 [============================>.] - ETA: 0s - loss: 0.0750 - accuracy: 0.9600
80/80 [==============================] - 1s 16ms/step - loss: 0.0751 - accuracy: 0.9600

80/80 [==============================] - 1s 19ms/step - loss: 0.0751 - accuracy: 0.9600 - val_loss: 1.6189 - val_accuracy: 0.7880
Epoch 24/50

 1/80 [..............................] - ETA: 0s - loss: 0.0674 - accuracy: 0.9600
 4/80 [>.............................] - ETA: 1s - loss: 0.0600 - accuracy: 0.9750
 7/80 [=>............................] - ETA: 1s - loss: 0.0523 - accuracy: 0.9743
11/80 [===>..........................] - ETA: 1s - loss: 0.0520 - accuracy: 0.9755
15/80 [====>.........................] - ETA: 1s - loss: 0.0594 - accuracy: 0.9707
19/80 [======>.......................] - ETA: 0s - loss: 0.0642 - accuracy: 0.9658
23/80 [=======>......................] - ETA: 0s - loss: 0.0694 - accuracy: 0.9652
27/80 [=========>....................] - ETA: 0s - loss: 0.0698 - accuracy: 0.9644
31/80 [==========>...................] - ETA: 0s - loss: 0.0696 - accuracy: 0.9642
35/80 [============>.................] - ETA: 0s - loss: 0.0710 - accuracy: 0.9634
39/80 [=============>................] - ETA: 0s - loss: 0.0717 - accuracy: 0.9623
42/80 [==============>...............] - ETA: 0s - loss: 0.0720 - accuracy: 0.9624
45/80 [===============>..............] - ETA: 0s - loss: 0.0712 - accuracy: 0.9631
48/80 [=================>............] - ETA: 0s - loss: 0.0705 - accuracy: 0.9633
51/80 [==================>...........] - ETA: 0s - loss: 0.0731 - accuracy: 0.9622
54/80 [===================>..........] - ETA: 0s - loss: 0.0718 - accuracy: 0.9626
57/80 [====================>.........] - ETA: 0s - loss: 0.0725 - accuracy: 0.9621
60/80 [=====================>........] - ETA: 0s - loss: 0.0707 - accuracy: 0.9628
63/80 [======================>.......] - ETA: 0s - loss: 0.0719 - accuracy: 0.9625
66/80 [=======================>......] - ETA: 0s - loss: 0.0723 - accuracy: 0.9627
69/80 [========================>.....] - ETA: 0s - loss: 0.0736 - accuracy: 0.9620
73/80 [==========================>...] - ETA: 0s - loss: 0.0737 - accuracy: 0.9621
77/80 [===========================>..] - ETA: 0s - loss: 0.0744 - accuracy: 0.9617
80/80 [==============================] - 1s 17ms/step - loss: 0.0758 - accuracy: 0.9608

80/80 [==============================] - 2s 19ms/step - loss: 0.0758 - accuracy: 0.9608 - val_loss: 1.7608 - val_accuracy: 0.7790
Epoch 25/50

 1/80 [..............................] - ETA: 0s - loss: 0.0697 - accuracy: 0.9800
 5/80 [>.............................] - ETA: 0s - loss: 0.0699 - accuracy: 0.9700
 9/80 [==>...........................] - ETA: 1s - loss: 0.0581 - accuracy: 0.9733
12/80 [===>..........................] - ETA: 1s - loss: 0.0577 - accuracy: 0.9742
15/80 [====>.........................] - ETA: 1s - loss: 0.0642 - accuracy: 0.9713
19/80 [======>.......................] - ETA: 0s - loss: 0.0708 - accuracy: 0.9668
22/80 [=======>......................] - ETA: 0s - loss: 0.0698 - accuracy: 0.9655
25/80 [========>.....................] - ETA: 0s - loss: 0.0689 - accuracy: 0.9660
28/80 [=========>....................] - ETA: 0s - loss: 0.0693 - accuracy: 0.9657
31/80 [==========>...................] - ETA: 0s - loss: 0.0678 - accuracy: 0.9658
35/80 [============>.................] - ETA: 0s - loss: 0.0643 - accuracy: 0.9674
38/80 [=============>................] - ETA: 0s - loss: 0.0679 - accuracy: 0.9650
41/80 [==============>...............] - ETA: 0s - loss: 0.0672 - accuracy: 0.9654
45/80 [===============>..............] - ETA: 0s - loss: 0.0685 - accuracy: 0.9653
48/80 [=================>............] - ETA: 0s - loss: 0.0667 - accuracy: 0.9663
51/80 [==================>...........] - ETA: 0s - loss: 0.0664 - accuracy: 0.9661
55/80 [===================>..........] - ETA: 0s - loss: 0.0682 - accuracy: 0.9647
58/80 [====================>.........] - ETA: 0s - loss: 0.0696 - accuracy: 0.9645
61/80 [=====================>........] - ETA: 0s - loss: 0.0712 - accuracy: 0.9634
64/80 [=======================>......] - ETA: 0s - loss: 0.0732 - accuracy: 0.9625
67/80 [========================>.....] - ETA: 0s - loss: 0.0728 - accuracy: 0.9627
70/80 [=========================>....] - ETA: 0s - loss: 0.0721 - accuracy: 0.9630
74/80 [==========================>...] - ETA: 0s - loss: 0.0722 - accuracy: 0.9628
78/80 [============================>.] - ETA: 0s - loss: 0.0722 - accuracy: 0.9628
80/80 [==============================] - 1s 17ms/step - loss: 0.0739 - accuracy: 0.9619

80/80 [==============================] - 2s 20ms/step - loss: 0.0739 - accuracy: 0.9619 - val_loss: 1.6956 - val_accuracy: 0.7860
Epoch 26/50

 1/80 [..............................] - ETA: 0s - loss: 0.0591 - accuracy: 0.9800
 5/80 [>.............................] - ETA: 0s - loss: 0.0737 - accuracy: 0.9660
 9/80 [==>...........................] - ETA: 0s - loss: 0.0624 - accuracy: 0.9667
13/80 [===>..........................] - ETA: 0s - loss: 0.0709 - accuracy: 0.9608
16/80 [=====>........................] - ETA: 0s - loss: 0.0665 - accuracy: 0.9625
19/80 [======>.......................] - ETA: 0s - loss: 0.0666 - accuracy: 0.9626
23/80 [=======>......................] - ETA: 0s - loss: 0.0728 - accuracy: 0.9600
27/80 [=========>....................] - ETA: 0s - loss: 0.0755 - accuracy: 0.9593
30/80 [==========>...................] - ETA: 0s - loss: 0.0736 - accuracy: 0.9603
33/80 [===========>..................] - ETA: 0s - loss: 0.0724 - accuracy: 0.9615
37/80 [============>.................] - ETA: 0s - loss: 0.0737 - accuracy: 0.9611
40/80 [==============>...............] - ETA: 0s - loss: 0.0725 - accuracy: 0.9617
43/80 [===============>..............] - ETA: 0s - loss: 0.0707 - accuracy: 0.9630
46/80 [================>.............] - ETA: 0s - loss: 0.0694 - accuracy: 0.9639
49/80 [=================>............] - ETA: 0s - loss: 0.0719 - accuracy: 0.9629
52/80 [==================>...........] - ETA: 0s - loss: 0.0748 - accuracy: 0.9617
55/80 [===================>..........] - ETA: 0s - loss: 0.0740 - accuracy: 0.9624
58/80 [====================>.........] - ETA: 0s - loss: 0.0745 - accuracy: 0.9621
61/80 [=====================>........] - ETA: 0s - loss: 0.0759 - accuracy: 0.9618
65/80 [=======================>......] - ETA: 0s - loss: 0.0771 - accuracy: 0.9617
68/80 [========================>.....] - ETA: 0s - loss: 0.0759 - accuracy: 0.9618
71/80 [=========================>....] - ETA: 0s - loss: 0.0760 - accuracy: 0.9618
75/80 [===========================>..] - ETA: 0s - loss: 0.0755 - accuracy: 0.9623
78/80 [============================>.] - ETA: 0s - loss: 0.0762 - accuracy: 0.9621
80/80 [==============================] - 1s 17ms/step - loss: 0.0762 - accuracy: 0.9620

80/80 [==============================] - 2s 20ms/step - loss: 0.0762 - accuracy: 0.9620 - val_loss: 1.6517 - val_accuracy: 0.7810
Epoch 27/50

 1/80 [..............................] - ETA: 0s - loss: 0.0841 - accuracy: 0.9600
 4/80 [>.............................] - ETA: 1s - loss: 0.0540 - accuracy: 0.9725
 8/80 [==>...........................] - ETA: 1s - loss: 0.0582 - accuracy: 0.9675
11/80 [===>..........................] - ETA: 1s - loss: 0.0623 - accuracy: 0.9673
14/80 [====>.........................] - ETA: 1s - loss: 0.0639 - accuracy: 0.9671
17/80 [=====>........................] - ETA: 1s - loss: 0.0677 - accuracy: 0.9641
20/80 [======>.......................] - ETA: 1s - loss: 0.0711 - accuracy: 0.9630
23/80 [=======>......................] - ETA: 0s - loss: 0.0705 - accuracy: 0.9617
26/80 [========>.....................] - ETA: 0s - loss: 0.0702 - accuracy: 0.9615
29/80 [=========>....................] - ETA: 0s - loss: 0.0681 - accuracy: 0.9628
32/80 [===========>..................] - ETA: 0s - loss: 0.0688 - accuracy: 0.9628
35/80 [============>.................] - ETA: 0s - loss: 0.0714 - accuracy: 0.9626
38/80 [=============>................] - ETA: 0s - loss: 0.0710 - accuracy: 0.9634
41/80 [==============>...............] - ETA: 0s - loss: 0.0728 - accuracy: 0.9627
44/80 [===============>..............] - ETA: 0s - loss: 0.0717 - accuracy: 0.9630
47/80 [================>.............] - ETA: 0s - loss: 0.0706 - accuracy: 0.9632
50/80 [=================>............] - ETA: 0s - loss: 0.0697 - accuracy: 0.9636
53/80 [==================>...........] - ETA: 0s - loss: 0.0704 - accuracy: 0.9623
56/80 [====================>.........] - ETA: 0s - loss: 0.0707 - accuracy: 0.9621
59/80 [=====================>........] - ETA: 0s - loss: 0.0707 - accuracy: 0.9624
62/80 [======================>.......] - ETA: 0s - loss: 0.0710 - accuracy: 0.9616
65/80 [=======================>......] - ETA: 0s - loss: 0.0717 - accuracy: 0.9617
68/80 [========================>.....] - ETA: 0s - loss: 0.0717 - accuracy: 0.9619
71/80 [=========================>....] - ETA: 0s - loss: 0.0711 - accuracy: 0.9620
74/80 [==========================>...] - ETA: 0s - loss: 0.0714 - accuracy: 0.9618
77/80 [===========================>..] - ETA: 0s - loss: 0.0727 - accuracy: 0.9609
80/80 [==============================] - 1s 17ms/step - loss: 0.0732 - accuracy: 0.9605

80/80 [==============================] - 2s 20ms/step - loss: 0.0732 - accuracy: 0.9605 - val_loss: 1.6911 - val_accuracy: 0.7840
Epoch 28/50

 1/80 [..............................] - ETA: 0s - loss: 0.0473 - accuracy: 0.9700
 4/80 [>.............................] - ETA: 0s - loss: 0.0691 - accuracy: 0.9575
 7/80 [=>............................] - ETA: 1s - loss: 0.0593 - accuracy: 0.9629
11/80 [===>..........................] - ETA: 1s - loss: 0.0586 - accuracy: 0.9609
14/80 [====>.........................] - ETA: 1s - loss: 0.0611 - accuracy: 0.9600
17/80 [=====>........................] - ETA: 1s - loss: 0.0584 - accuracy: 0.9618
20/80 [======>.......................] - ETA: 1s - loss: 0.0656 - accuracy: 0.9600
23/80 [=======>......................] - ETA: 0s - loss: 0.0681 - accuracy: 0.9609
26/80 [========>.....................] - ETA: 0s - loss: 0.0642 - accuracy: 0.9631
29/80 [=========>....................] - ETA: 0s - loss: 0.0632 - accuracy: 0.9631
32/80 [===========>..................] - ETA: 0s - loss: 0.0664 - accuracy: 0.9619
35/80 [============>.................] - ETA: 0s - loss: 0.0665 - accuracy: 0.9617
38/80 [=============>................] - ETA: 0s - loss: 0.0678 - accuracy: 0.9613
41/80 [==============>...............] - ETA: 0s - loss: 0.0693 - accuracy: 0.9607
44/80 [===============>..............] - ETA: 0s - loss: 0.0682 - accuracy: 0.9616
47/80 [================>.............] - ETA: 0s - loss: 0.0704 - accuracy: 0.9602
50/80 [=================>............] - ETA: 0s - loss: 0.0706 - accuracy: 0.9610
53/80 [==================>...........] - ETA: 0s - loss: 0.0718 - accuracy: 0.9608
56/80 [====================>.........] - ETA: 0s - loss: 0.0716 - accuracy: 0.9605
59/80 [=====================>........] - ETA: 0s - loss: 0.0734 - accuracy: 0.9597
62/80 [======================>.......] - ETA: 0s - loss: 0.0735 - accuracy: 0.9602
65/80 [=======================>......] - ETA: 0s - loss: 0.0733 - accuracy: 0.9603
68/80 [========================>.....] - ETA: 0s - loss: 0.0728 - accuracy: 0.9609
71/80 [=========================>....] - ETA: 0s - loss: 0.0718 - accuracy: 0.9614
74/80 [==========================>...] - ETA: 0s - loss: 0.0707 - accuracy: 0.9620
77/80 [===========================>..] - ETA: 0s - loss: 0.0708 - accuracy: 0.9619
80/80 [==============================] - 1s 18ms/step - loss: 0.0713 - accuracy: 0.9614

80/80 [==============================] - 2s 21ms/step - loss: 0.0713 - accuracy: 0.9614 - val_loss: 1.7854 - val_accuracy: 0.7780
Epoch 29/50

 1/80 [..............................] - ETA: 0s - loss: 0.1085 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 1s - loss: 0.0587 - accuracy: 0.9760
 8/80 [==>...........................] - ETA: 1s - loss: 0.0630 - accuracy: 0.9725
11/80 [===>..........................] - ETA: 1s - loss: 0.0654 - accuracy: 0.9718
14/80 [====>.........................] - ETA: 1s - loss: 0.0672 - accuracy: 0.9700
18/80 [=====>........................] - ETA: 0s - loss: 0.0709 - accuracy: 0.9678
21/80 [======>.......................] - ETA: 0s - loss: 0.0731 - accuracy: 0.9657
24/80 [========>.....................] - ETA: 0s - loss: 0.0708 - accuracy: 0.9663
27/80 [=========>....................] - ETA: 0s - loss: 0.0674 - accuracy: 0.9678
30/80 [==========>...................] - ETA: 0s - loss: 0.0673 - accuracy: 0.9677
33/80 [===========>..................] - ETA: 0s - loss: 0.0673 - accuracy: 0.9679
36/80 [============>.................] - ETA: 0s - loss: 0.0684 - accuracy: 0.9672
39/80 [=============>................] - ETA: 0s - loss: 0.0694 - accuracy: 0.9667
42/80 [==============>...............] - ETA: 0s - loss: 0.0711 - accuracy: 0.9657
45/80 [===============>..............] - ETA: 0s - loss: 0.0696 - accuracy: 0.9662
48/80 [=================>............] - ETA: 0s - loss: 0.0704 - accuracy: 0.9658
51/80 [==================>...........] - ETA: 0s - loss: 0.0706 - accuracy: 0.9659
54/80 [===================>..........] - ETA: 0s - loss: 0.0711 - accuracy: 0.9656
57/80 [====================>.........] - ETA: 0s - loss: 0.0731 - accuracy: 0.9644
60/80 [=====================>........] - ETA: 0s - loss: 0.0725 - accuracy: 0.9645
63/80 [======================>.......] - ETA: 0s - loss: 0.0722 - accuracy: 0.9641
66/80 [=======================>......] - ETA: 0s - loss: 0.0729 - accuracy: 0.9639
69/80 [========================>.....] - ETA: 0s - loss: 0.0730 - accuracy: 0.9641
72/80 [==========================>...] - ETA: 0s - loss: 0.0730 - accuracy: 0.9642
75/80 [===========================>..] - ETA: 0s - loss: 0.0719 - accuracy: 0.9649
78/80 [============================>.] - ETA: 0s - loss: 0.0729 - accuracy: 0.9642
80/80 [==============================] - 1s 17ms/step - loss: 0.0735 - accuracy: 0.9639

80/80 [==============================] - 2s 20ms/step - loss: 0.0735 - accuracy: 0.9639 - val_loss: 1.7483 - val_accuracy: 0.7850
Epoch 30/50

 1/80 [..............................] - ETA: 0s - loss: 0.1176 - accuracy: 0.9300
 5/80 [>.............................] - ETA: 0s - loss: 0.0727 - accuracy: 0.9620
 9/80 [==>...........................] - ETA: 1s - loss: 0.0775 - accuracy: 0.9622
13/80 [===>..........................] - ETA: 1s - loss: 0.0676 - accuracy: 0.9662
16/80 [=====>........................] - ETA: 1s - loss: 0.0652 - accuracy: 0.9675
19/80 [======>.......................] - ETA: 0s - loss: 0.0662 - accuracy: 0.9684
22/80 [=======>......................] - ETA: 0s - loss: 0.0659 - accuracy: 0.9686
25/80 [========>.....................] - ETA: 0s - loss: 0.0641 - accuracy: 0.9696
28/80 [=========>....................] - ETA: 0s - loss: 0.0665 - accuracy: 0.9679
31/80 [==========>...................] - ETA: 0s - loss: 0.0681 - accuracy: 0.9668
34/80 [===========>..................] - ETA: 0s - loss: 0.0677 - accuracy: 0.9668
37/80 [============>.................] - ETA: 0s - loss: 0.0687 - accuracy: 0.9651
40/80 [==============>...............] - ETA: 0s - loss: 0.0690 - accuracy: 0.9650
43/80 [===============>..............] - ETA: 0s - loss: 0.0676 - accuracy: 0.9651
46/80 [================>.............] - ETA: 0s - loss: 0.0675 - accuracy: 0.9648
49/80 [=================>............] - ETA: 0s - loss: 0.0661 - accuracy: 0.9655
52/80 [==================>...........] - ETA: 0s - loss: 0.0648 - accuracy: 0.9663
55/80 [===================>..........] - ETA: 0s - loss: 0.0652 - accuracy: 0.9664
58/80 [====================>.........] - ETA: 0s - loss: 0.0651 - accuracy: 0.9666
61/80 [=====================>........] - ETA: 0s - loss: 0.0683 - accuracy: 0.9656
64/80 [=======================>......] - ETA: 0s - loss: 0.0684 - accuracy: 0.9652
67/80 [========================>.....] - ETA: 0s - loss: 0.0697 - accuracy: 0.9643
70/80 [=========================>....] - ETA: 0s - loss: 0.0705 - accuracy: 0.9640
73/80 [==========================>...] - ETA: 0s - loss: 0.0699 - accuracy: 0.9645
76/80 [===========================>..] - ETA: 0s - loss: 0.0699 - accuracy: 0.9645
79/80 [============================>.] - ETA: 0s - loss: 0.0706 - accuracy: 0.9641
80/80 [==============================] - 1s 17ms/step - loss: 0.0708 - accuracy: 0.9638

80/80 [==============================] - 2s 20ms/step - loss: 0.0708 - accuracy: 0.9638 - val_loss: 1.7467 - val_accuracy: 0.7810
Epoch 31/50

 1/80 [..............................] - ETA: 0s - loss: 0.0699 - accuracy: 0.9600
 5/80 [>.............................] - ETA: 0s - loss: 0.0807 - accuracy: 0.9540
 9/80 [==>...........................] - ETA: 1s - loss: 0.0704 - accuracy: 0.9633
12/80 [===>..........................] - ETA: 1s - loss: 0.0712 - accuracy: 0.9617
15/80 [====>.........................] - ETA: 1s - loss: 0.0697 - accuracy: 0.9627
18/80 [=====>........................] - ETA: 1s - loss: 0.0722 - accuracy: 0.9628
22/80 [=======>......................] - ETA: 0s - loss: 0.0706 - accuracy: 0.9632
26/80 [========>.....................] - ETA: 0s - loss: 0.0716 - accuracy: 0.9627
30/80 [==========>...................] - ETA: 0s - loss: 0.0709 - accuracy: 0.9623
34/80 [===========>..................] - ETA: 0s - loss: 0.0720 - accuracy: 0.9618
37/80 [============>.................] - ETA: 0s - loss: 0.0718 - accuracy: 0.9614
40/80 [==============>...............] - ETA: 0s - loss: 0.0728 - accuracy: 0.9607
43/80 [===============>..............] - ETA: 0s - loss: 0.0739 - accuracy: 0.9605
47/80 [================>.............] - ETA: 0s - loss: 0.0737 - accuracy: 0.9606
50/80 [=================>............] - ETA: 0s - loss: 0.0736 - accuracy: 0.9606
54/80 [===================>..........] - ETA: 0s - loss: 0.0724 - accuracy: 0.9615
57/80 [====================>.........] - ETA: 0s - loss: 0.0730 - accuracy: 0.9614
61/80 [=====================>........] - ETA: 0s - loss: 0.0720 - accuracy: 0.9620
64/80 [=======================>......] - ETA: 0s - loss: 0.0705 - accuracy: 0.9628
67/80 [========================>.....] - ETA: 0s - loss: 0.0717 - accuracy: 0.9628
70/80 [=========================>....] - ETA: 0s - loss: 0.0731 - accuracy: 0.9620
73/80 [==========================>...] - ETA: 0s - loss: 0.0735 - accuracy: 0.9621
76/80 [===========================>..] - ETA: 0s - loss: 0.0743 - accuracy: 0.9618
80/80 [==============================] - 1s 17ms/step - loss: 0.0743 - accuracy: 0.9617

80/80 [==============================] - 2s 20ms/step - loss: 0.0743 - accuracy: 0.9617 - val_loss: 1.6636 - val_accuracy: 0.7840
Epoch 32/50

 1/80 [..............................] - ETA: 0s - loss: 0.0730 - accuracy: 0.9500
 5/80 [>.............................] - ETA: 0s - loss: 0.0549 - accuracy: 0.9720
 8/80 [==>...........................] - ETA: 1s - loss: 0.0510 - accuracy: 0.9750
12/80 [===>..........................] - ETA: 1s - loss: 0.0590 - accuracy: 0.9700
16/80 [=====>........................] - ETA: 0s - loss: 0.0581 - accuracy: 0.9700
19/80 [======>.......................] - ETA: 0s - loss: 0.0617 - accuracy: 0.9684
22/80 [=======>......................] - ETA: 0s - loss: 0.0616 - accuracy: 0.9668
25/80 [========>.....................] - ETA: 0s - loss: 0.0658 - accuracy: 0.9648
29/80 [=========>....................] - ETA: 0s - loss: 0.0673 - accuracy: 0.9638
33/80 [===========>..................] - ETA: 0s - loss: 0.0672 - accuracy: 0.9639
36/80 [============>.................] - ETA: 0s - loss: 0.0661 - accuracy: 0.9644
40/80 [==============>...............] - ETA: 0s - loss: 0.0633 - accuracy: 0.9660
43/80 [===============>..............] - ETA: 0s - loss: 0.0652 - accuracy: 0.9651
46/80 [================>.............] - ETA: 0s - loss: 0.0655 - accuracy: 0.9650
49/80 [=================>............] - ETA: 0s - loss: 0.0653 - accuracy: 0.9653
52/80 [==================>...........] - ETA: 0s - loss: 0.0666 - accuracy: 0.9648
55/80 [===================>..........] - ETA: 0s - loss: 0.0668 - accuracy: 0.9651
59/80 [=====================>........] - ETA: 0s - loss: 0.0668 - accuracy: 0.9653
63/80 [======================>.......] - ETA: 0s - loss: 0.0668 - accuracy: 0.9654
67/80 [========================>.....] - ETA: 0s - loss: 0.0671 - accuracy: 0.9649
71/80 [=========================>....] - ETA: 0s - loss: 0.0681 - accuracy: 0.9646
75/80 [===========================>..] - ETA: 0s - loss: 0.0696 - accuracy: 0.9641
79/80 [============================>.] - ETA: 0s - loss: 0.0704 - accuracy: 0.9638
80/80 [==============================] - 1s 16ms/step - loss: 0.0701 - accuracy: 0.9638

80/80 [==============================] - 2s 19ms/step - loss: 0.0701 - accuracy: 0.9638 - val_loss: 1.8172 - val_accuracy: 0.7750
Epoch 33/50

 1/80 [..............................] - ETA: 0s - loss: 0.0768 - accuracy: 0.9600
 5/80 [>.............................] - ETA: 0s - loss: 0.0577 - accuracy: 0.9700
 9/80 [==>...........................] - ETA: 0s - loss: 0.0501 - accuracy: 0.9744
12/80 [===>..........................] - ETA: 0s - loss: 0.0454 - accuracy: 0.9775
15/80 [====>.........................] - ETA: 0s - loss: 0.0454 - accuracy: 0.9767
19/80 [======>.......................] - ETA: 0s - loss: 0.0477 - accuracy: 0.9747
23/80 [=======>......................] - ETA: 0s - loss: 0.0540 - accuracy: 0.9709
26/80 [========>.....................] - ETA: 0s - loss: 0.0551 - accuracy: 0.9704
29/80 [=========>....................] - ETA: 0s - loss: 0.0576 - accuracy: 0.9693
33/80 [===========>..................] - ETA: 0s - loss: 0.0608 - accuracy: 0.9676
37/80 [============>.................] - ETA: 0s - loss: 0.0616 - accuracy: 0.9670
41/80 [==============>...............] - ETA: 0s - loss: 0.0623 - accuracy: 0.9661
44/80 [===============>..............] - ETA: 0s - loss: 0.0628 - accuracy: 0.9659
48/80 [=================>............] - ETA: 0s - loss: 0.0654 - accuracy: 0.9648
52/80 [==================>...........] - ETA: 0s - loss: 0.0653 - accuracy: 0.9646
55/80 [===================>..........] - ETA: 0s - loss: 0.0657 - accuracy: 0.9642
58/80 [====================>.........] - ETA: 0s - loss: 0.0650 - accuracy: 0.9645
62/80 [======================>.......] - ETA: 0s - loss: 0.0658 - accuracy: 0.9644
66/80 [=======================>......] - ETA: 0s - loss: 0.0675 - accuracy: 0.9635
70/80 [=========================>....] - ETA: 0s - loss: 0.0699 - accuracy: 0.9623
74/80 [==========================>...] - ETA: 0s - loss: 0.0705 - accuracy: 0.9620
78/80 [============================>.] - ETA: 0s - loss: 0.0701 - accuracy: 0.9622
80/80 [==============================] - 1s 16ms/step - loss: 0.0699 - accuracy: 0.9623

80/80 [==============================] - 1s 19ms/step - loss: 0.0699 - accuracy: 0.9623 - val_loss: 1.8216 - val_accuracy: 0.7820
Epoch 34/50

 1/80 [..............................] - ETA: 0s - loss: 0.0817 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.0691 - accuracy: 0.9660
 9/80 [==>...........................] - ETA: 0s - loss: 0.0717 - accuracy: 0.9611
13/80 [===>..........................] - ETA: 0s - loss: 0.0653 - accuracy: 0.9654
17/80 [=====>........................] - ETA: 0s - loss: 0.0656 - accuracy: 0.9641
21/80 [======>.......................] - ETA: 0s - loss: 0.0657 - accuracy: 0.9624
25/80 [========>.....................] - ETA: 0s - loss: 0.0639 - accuracy: 0.9644
29/80 [=========>....................] - ETA: 0s - loss: 0.0650 - accuracy: 0.9655
33/80 [===========>..................] - ETA: 0s - loss: 0.0664 - accuracy: 0.9642
37/80 [============>.................] - ETA: 0s - loss: 0.0677 - accuracy: 0.9635
41/80 [==============>...............] - ETA: 0s - loss: 0.0676 - accuracy: 0.9646
45/80 [===============>..............] - ETA: 0s - loss: 0.0650 - accuracy: 0.9660
49/80 [=================>............] - ETA: 0s - loss: 0.0706 - accuracy: 0.9633
53/80 [==================>...........] - ETA: 0s - loss: 0.0706 - accuracy: 0.9634
57/80 [====================>.........] - ETA: 0s - loss: 0.0704 - accuracy: 0.9632
61/80 [=====================>........] - ETA: 0s - loss: 0.0688 - accuracy: 0.9638
65/80 [=======================>......] - ETA: 0s - loss: 0.0692 - accuracy: 0.9637
69/80 [========================>.....] - ETA: 0s - loss: 0.0692 - accuracy: 0.9638
73/80 [==========================>...] - ETA: 0s - loss: 0.0703 - accuracy: 0.9636
77/80 [===========================>..] - ETA: 0s - loss: 0.0714 - accuracy: 0.9634
80/80 [==============================] - 1s 15ms/step - loss: 0.0729 - accuracy: 0.9627

80/80 [==============================] - 1s 18ms/step - loss: 0.0729 - accuracy: 0.9627 - val_loss: 1.7923 - val_accuracy: 0.7780
Epoch 35/50

 1/80 [..............................] - ETA: 0s - loss: 0.0868 - accuracy: 0.9500
 5/80 [>.............................] - ETA: 0s - loss: 0.0551 - accuracy: 0.9680
 9/80 [==>...........................] - ETA: 0s - loss: 0.0522 - accuracy: 0.9722
13/80 [===>..........................] - ETA: 0s - loss: 0.0541 - accuracy: 0.9708
17/80 [=====>........................] - ETA: 0s - loss: 0.0604 - accuracy: 0.9676
21/80 [======>.......................] - ETA: 0s - loss: 0.0613 - accuracy: 0.9676
25/80 [========>.....................] - ETA: 0s - loss: 0.0644 - accuracy: 0.9664
29/80 [=========>....................] - ETA: 0s - loss: 0.0638 - accuracy: 0.9659
33/80 [===========>..................] - ETA: 0s - loss: 0.0644 - accuracy: 0.9652
37/80 [============>.................] - ETA: 0s - loss: 0.0622 - accuracy: 0.9668
41/80 [==============>...............] - ETA: 0s - loss: 0.0624 - accuracy: 0.9673
45/80 [===============>..............] - ETA: 0s - loss: 0.0623 - accuracy: 0.9676
49/80 [=================>............] - ETA: 0s - loss: 0.0633 - accuracy: 0.9676
53/80 [==================>...........] - ETA: 0s - loss: 0.0658 - accuracy: 0.9664
57/80 [====================>.........] - ETA: 0s - loss: 0.0670 - accuracy: 0.9649
61/80 [=====================>........] - ETA: 0s - loss: 0.0689 - accuracy: 0.9643
65/80 [=======================>......] - ETA: 0s - loss: 0.0708 - accuracy: 0.9635
69/80 [========================>.....] - ETA: 0s - loss: 0.0715 - accuracy: 0.9638
73/80 [==========================>...] - ETA: 0s - loss: 0.0721 - accuracy: 0.9630
76/80 [===========================>..] - ETA: 0s - loss: 0.0717 - accuracy: 0.9632
80/80 [==============================] - 1s 15ms/step - loss: 0.0731 - accuracy: 0.9629

80/80 [==============================] - 1s 18ms/step - loss: 0.0731 - accuracy: 0.9629 - val_loss: 1.7614 - val_accuracy: 0.7880
Epoch 36/50

 1/80 [..............................] - ETA: 0s - loss: 0.1237 - accuracy: 0.9400
 5/80 [>.............................] - ETA: 0s - loss: 0.0900 - accuracy: 0.9540
 9/80 [==>...........................] - ETA: 0s - loss: 0.0849 - accuracy: 0.9600
13/80 [===>..........................] - ETA: 0s - loss: 0.0776 - accuracy: 0.9615
17/80 [=====>........................] - ETA: 0s - loss: 0.0806 - accuracy: 0.9588
21/80 [======>.......................] - ETA: 0s - loss: 0.0742 - accuracy: 0.9614
25/80 [========>.....................] - ETA: 0s - loss: 0.0730 - accuracy: 0.9616
29/80 [=========>....................] - ETA: 0s - loss: 0.0705 - accuracy: 0.9621
33/80 [===========>..................] - ETA: 0s - loss: 0.0710 - accuracy: 0.9624
37/80 [============>.................] - ETA: 0s - loss: 0.0728 - accuracy: 0.9608
41/80 [==============>...............] - ETA: 0s - loss: 0.0762 - accuracy: 0.9588
45/80 [===============>..............] - ETA: 0s - loss: 0.0770 - accuracy: 0.9582
49/80 [=================>............] - ETA: 0s - loss: 0.0765 - accuracy: 0.9586
53/80 [==================>...........] - ETA: 0s - loss: 0.0751 - accuracy: 0.9592
57/80 [====================>.........] - ETA: 0s - loss: 0.0758 - accuracy: 0.9593
61/80 [=====================>........] - ETA: 0s - loss: 0.0751 - accuracy: 0.9595
65/80 [=======================>......] - ETA: 0s - loss: 0.0748 - accuracy: 0.9600
69/80 [========================>.....] - ETA: 0s - loss: 0.0746 - accuracy: 0.9596
73/80 [==========================>...] - ETA: 0s - loss: 0.0741 - accuracy: 0.9596
77/80 [===========================>..] - ETA: 0s - loss: 0.0752 - accuracy: 0.9596
80/80 [==============================] - 1s 15ms/step - loss: 0.0748 - accuracy: 0.9595

80/80 [==============================] - 1s 17ms/step - loss: 0.0748 - accuracy: 0.9595 - val_loss: 1.7273 - val_accuracy: 0.7830
Epoch 37/50

 1/80 [..............................] - ETA: 0s - loss: 0.0498 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.0638 - accuracy: 0.9640
 9/80 [==>...........................] - ETA: 0s - loss: 0.0565 - accuracy: 0.9678
13/80 [===>..........................] - ETA: 0s - loss: 0.0634 - accuracy: 0.9685
17/80 [=====>........................] - ETA: 0s - loss: 0.0672 - accuracy: 0.9676
21/80 [======>.......................] - ETA: 0s - loss: 0.0694 - accuracy: 0.9657
25/80 [========>.....................] - ETA: 0s - loss: 0.0682 - accuracy: 0.9664
29/80 [=========>....................] - ETA: 0s - loss: 0.0687 - accuracy: 0.9659
33/80 [===========>..................] - ETA: 0s - loss: 0.0645 - accuracy: 0.9679
37/80 [============>.................] - ETA: 0s - loss: 0.0677 - accuracy: 0.9665
41/80 [==============>...............] - ETA: 0s - loss: 0.0673 - accuracy: 0.9668
45/80 [===============>..............] - ETA: 0s - loss: 0.0700 - accuracy: 0.9660
49/80 [=================>............] - ETA: 0s - loss: 0.0721 - accuracy: 0.9649
53/80 [==================>...........] - ETA: 0s - loss: 0.0730 - accuracy: 0.9642
57/80 [====================>.........] - ETA: 0s - loss: 0.0722 - accuracy: 0.9639
61/80 [=====================>........] - ETA: 0s - loss: 0.0747 - accuracy: 0.9628
65/80 [=======================>......] - ETA: 0s - loss: 0.0749 - accuracy: 0.9629
69/80 [========================>.....] - ETA: 0s - loss: 0.0752 - accuracy: 0.9630
73/80 [==========================>...] - ETA: 0s - loss: 0.0751 - accuracy: 0.9626
77/80 [===========================>..] - ETA: 0s - loss: 0.0769 - accuracy: 0.9623
80/80 [==============================] - 1s 15ms/step - loss: 0.0763 - accuracy: 0.9627

80/80 [==============================] - 1s 17ms/step - loss: 0.0763 - accuracy: 0.9627 - val_loss: 1.7957 - val_accuracy: 0.7640
Epoch 38/50

 1/80 [..............................] - ETA: 0s - loss: 0.0143 - accuracy: 1.0000
 5/80 [>.............................] - ETA: 0s - loss: 0.0532 - accuracy: 0.9780
 9/80 [==>...........................] - ETA: 0s - loss: 0.0572 - accuracy: 0.9722
13/80 [===>..........................] - ETA: 0s - loss: 0.0579 - accuracy: 0.9708
17/80 [=====>........................] - ETA: 0s - loss: 0.0616 - accuracy: 0.9659
21/80 [======>.......................] - ETA: 0s - loss: 0.0624 - accuracy: 0.9662
25/80 [========>.....................] - ETA: 0s - loss: 0.0621 - accuracy: 0.9668
29/80 [=========>....................] - ETA: 0s - loss: 0.0647 - accuracy: 0.9659
33/80 [===========>..................] - ETA: 0s - loss: 0.0706 - accuracy: 0.9639
37/80 [============>.................] - ETA: 0s - loss: 0.0731 - accuracy: 0.9627
41/80 [==============>...............] - ETA: 0s - loss: 0.0777 - accuracy: 0.9615
45/80 [===============>..............] - ETA: 0s - loss: 0.0819 - accuracy: 0.9587
49/80 [=================>............] - ETA: 0s - loss: 0.0884 - accuracy: 0.9576
53/80 [==================>...........] - ETA: 0s - loss: 0.0898 - accuracy: 0.9566
56/80 [====================>.........] - ETA: 0s - loss: 0.0883 - accuracy: 0.9575
60/80 [=====================>........] - ETA: 0s - loss: 0.0884 - accuracy: 0.9582
64/80 [=======================>......] - ETA: 0s - loss: 0.0885 - accuracy: 0.9581
68/80 [========================>.....] - ETA: 0s - loss: 0.0902 - accuracy: 0.9568
72/80 [==========================>...] - ETA: 0s - loss: 0.0957 - accuracy: 0.9553
76/80 [===========================>..] - ETA: 0s - loss: 0.0975 - accuracy: 0.9549
80/80 [==============================] - 1s 15ms/step - loss: 0.0999 - accuracy: 0.9541

80/80 [==============================] - 1s 17ms/step - loss: 0.0999 - accuracy: 0.9541 - val_loss: 1.7177 - val_accuracy: 0.7640
Epoch 39/50

 1/80 [..............................] - ETA: 0s - loss: 0.0781 - accuracy: 0.9800
 5/80 [>.............................] - ETA: 0s - loss: 0.1292 - accuracy: 0.9520
 9/80 [==>...........................] - ETA: 0s - loss: 0.1239 - accuracy: 0.9522
13/80 [===>..........................] - ETA: 0s - loss: 0.1126 - accuracy: 0.9554
17/80 [=====>........................] - ETA: 0s - loss: 0.1053 - accuracy: 0.9559
21/80 [======>.......................] - ETA: 0s - loss: 0.1025 - accuracy: 0.9567
25/80 [========>.....................] - ETA: 0s - loss: 0.1094 - accuracy: 0.9556
29/80 [=========>....................] - ETA: 0s - loss: 0.1084 - accuracy: 0.9555
33/80 [===========>..................] - ETA: 0s - loss: 0.1134 - accuracy: 0.9555
37/80 [============>.................] - ETA: 0s - loss: 0.1230 - accuracy: 0.9530
41/80 [==============>...............] - ETA: 0s - loss: 0.1263 - accuracy: 0.9532
45/80 [===============>..............] - ETA: 0s - loss: 0.1343 - accuracy: 0.9513
49/80 [=================>............] - ETA: 0s - loss: 0.1326 - accuracy: 0.9524
53/80 [==================>...........] - ETA: 0s - loss: 0.1347 - accuracy: 0.9517
57/80 [====================>.........] - ETA: 0s - loss: 0.1359 - accuracy: 0.9502
61/80 [=====================>........] - ETA: 0s - loss: 0.1365 - accuracy: 0.9497
65/80 [=======================>......] - ETA: 0s - loss: 0.1417 - accuracy: 0.9483
69/80 [========================>.....] - ETA: 0s - loss: 0.1450 - accuracy: 0.9471
73/80 [==========================>...] - ETA: 0s - loss: 0.1473 - accuracy: 0.9458
77/80 [===========================>..] - ETA: 0s - loss: 0.1515 - accuracy: 0.9451
80/80 [==============================] - 1s 14ms/step - loss: 0.1544 - accuracy: 0.9444

80/80 [==============================] - 1s 17ms/step - loss: 0.1544 - accuracy: 0.9444 - val_loss: 1.6399 - val_accuracy: 0.7590
Epoch 40/50

 1/80 [..............................] - ETA: 0s - loss: 0.1244 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.1238 - accuracy: 0.9600
 9/80 [==>...........................] - ETA: 0s - loss: 0.1310 - accuracy: 0.9556
13/80 [===>..........................] - ETA: 0s - loss: 0.1347 - accuracy: 0.9554
17/80 [=====>........................] - ETA: 0s - loss: 0.1312 - accuracy: 0.9541
21/80 [======>.......................] - ETA: 0s - loss: 0.1259 - accuracy: 0.9529
25/80 [========>.....................] - ETA: 0s - loss: 0.1245 - accuracy: 0.9540
29/80 [=========>....................] - ETA: 0s - loss: 0.1255 - accuracy: 0.9531
33/80 [===========>..................] - ETA: 0s - loss: 0.1301 - accuracy: 0.9533
37/80 [============>.................] - ETA: 0s - loss: 0.1317 - accuracy: 0.9527
41/80 [==============>...............] - ETA: 0s - loss: 0.1320 - accuracy: 0.9520
45/80 [===============>..............] - ETA: 0s - loss: 0.1342 - accuracy: 0.9522
49/80 [=================>............] - ETA: 0s - loss: 0.1386 - accuracy: 0.9500
53/80 [==================>...........] - ETA: 0s - loss: 0.1372 - accuracy: 0.9500
57/80 [====================>.........] - ETA: 0s - loss: 0.1412 - accuracy: 0.9489
61/80 [=====================>........] - ETA: 0s - loss: 0.1410 - accuracy: 0.9489
65/80 [=======================>......] - ETA: 0s - loss: 0.1410 - accuracy: 0.9491
69/80 [========================>.....] - ETA: 0s - loss: 0.1409 - accuracy: 0.9491
73/80 [==========================>...] - ETA: 0s - loss: 0.1387 - accuracy: 0.9497
77/80 [===========================>..] - ETA: 0s - loss: 0.1394 - accuracy: 0.9494
80/80 [==============================] - 1s 15ms/step - loss: 0.1400 - accuracy: 0.9491

80/80 [==============================] - 1s 17ms/step - loss: 0.1400 - accuracy: 0.9491 - val_loss: 1.7951 - val_accuracy: 0.7710
Epoch 41/50

 1/80 [..............................] - ETA: 0s - loss: 0.1229 - accuracy: 0.9500
 5/80 [>.............................] - ETA: 0s - loss: 0.1142 - accuracy: 0.9480
 9/80 [==>...........................] - ETA: 0s - loss: 0.1103 - accuracy: 0.9489
13/80 [===>..........................] - ETA: 0s - loss: 0.1006 - accuracy: 0.9538
17/80 [=====>........................] - ETA: 0s - loss: 0.1005 - accuracy: 0.9547
21/80 [======>.......................] - ETA: 0s - loss: 0.1032 - accuracy: 0.9529
25/80 [========>.....................] - ETA: 0s - loss: 0.1046 - accuracy: 0.9544
29/80 [=========>....................] - ETA: 0s - loss: 0.1080 - accuracy: 0.9514
33/80 [===========>..................] - ETA: 0s - loss: 0.1059 - accuracy: 0.9539
37/80 [============>.................] - ETA: 0s - loss: 0.1029 - accuracy: 0.9554
41/80 [==============>...............] - ETA: 0s - loss: 0.1043 - accuracy: 0.9551
45/80 [===============>..............] - ETA: 0s - loss: 0.1057 - accuracy: 0.9547
49/80 [=================>............] - ETA: 0s - loss: 0.1052 - accuracy: 0.9557
53/80 [==================>...........] - ETA: 0s - loss: 0.1082 - accuracy: 0.9538
57/80 [====================>.........] - ETA: 0s - loss: 0.1073 - accuracy: 0.9540
61/80 [=====================>........] - ETA: 0s - loss: 0.1062 - accuracy: 0.9551
65/80 [=======================>......] - ETA: 0s - loss: 0.1051 - accuracy: 0.9557
69/80 [========================>.....] - ETA: 0s - loss: 0.1048 - accuracy: 0.9561
73/80 [==========================>...] - ETA: 0s - loss: 0.1092 - accuracy: 0.9549
77/80 [===========================>..] - ETA: 0s - loss: 0.1082 - accuracy: 0.9551
80/80 [==============================] - 1s 15ms/step - loss: 0.1080 - accuracy: 0.9555

80/80 [==============================] - 1s 17ms/step - loss: 0.1080 - accuracy: 0.9555 - val_loss: 1.6732 - val_accuracy: 0.7680
Epoch 42/50

 1/80 [..............................] - ETA: 0s - loss: 0.0859 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.0944 - accuracy: 0.9600
 8/80 [==>...........................] - ETA: 0s - loss: 0.0927 - accuracy: 0.9563
12/80 [===>..........................] - ETA: 0s - loss: 0.0842 - accuracy: 0.9608
16/80 [=====>........................] - ETA: 0s - loss: 0.0894 - accuracy: 0.9588
19/80 [======>.......................] - ETA: 0s - loss: 0.0903 - accuracy: 0.9589
22/80 [=======>......................] - ETA: 0s - loss: 0.0837 - accuracy: 0.9627
26/80 [========>.....................] - ETA: 0s - loss: 0.0848 - accuracy: 0.9619
30/80 [==========>...................] - ETA: 0s - loss: 0.0844 - accuracy: 0.9620
34/80 [===========>..................] - ETA: 0s - loss: 0.0860 - accuracy: 0.9612
38/80 [=============>................] - ETA: 0s - loss: 0.0857 - accuracy: 0.9618
42/80 [==============>...............] - ETA: 0s - loss: 0.0857 - accuracy: 0.9617
46/80 [================>.............] - ETA: 0s - loss: 0.0851 - accuracy: 0.9620
50/80 [=================>............] - ETA: 0s - loss: 0.0846 - accuracy: 0.9618
54/80 [===================>..........] - ETA: 0s - loss: 0.0849 - accuracy: 0.9617
58/80 [====================>.........] - ETA: 0s - loss: 0.0871 - accuracy: 0.9610
62/80 [======================>.......] - ETA: 0s - loss: 0.0886 - accuracy: 0.9613
66/80 [=======================>......] - ETA: 0s - loss: 0.0898 - accuracy: 0.9611
70/80 [=========================>....] - ETA: 0s - loss: 0.0884 - accuracy: 0.9617
74/80 [==========================>...] - ETA: 0s - loss: 0.0899 - accuracy: 0.9609
78/80 [============================>.] - ETA: 0s - loss: 0.0902 - accuracy: 0.9610
80/80 [==============================] - 1s 15ms/step - loss: 0.0915 - accuracy: 0.9608

80/80 [==============================] - 1s 18ms/step - loss: 0.0915 - accuracy: 0.9608 - val_loss: 1.7656 - val_accuracy: 0.7690
Epoch 43/50

 1/80 [..............................] - ETA: 0s - loss: 0.0282 - accuracy: 0.9800
 5/80 [>.............................] - ETA: 0s - loss: 0.0666 - accuracy: 0.9640
 9/80 [==>...........................] - ETA: 0s - loss: 0.0653 - accuracy: 0.9644
13/80 [===>..........................] - ETA: 0s - loss: 0.0647 - accuracy: 0.9654
17/80 [=====>........................] - ETA: 0s - loss: 0.0633 - accuracy: 0.9671
21/80 [======>.......................] - ETA: 0s - loss: 0.0744 - accuracy: 0.9614
25/80 [========>.....................] - ETA: 0s - loss: 0.0737 - accuracy: 0.9628
29/80 [=========>....................] - ETA: 0s - loss: 0.0733 - accuracy: 0.9624
33/80 [===========>..................] - ETA: 0s - loss: 0.0744 - accuracy: 0.9621
37/80 [============>.................] - ETA: 0s - loss: 0.0738 - accuracy: 0.9622
41/80 [==============>...............] - ETA: 0s - loss: 0.0718 - accuracy: 0.9637
45/80 [===============>..............] - ETA: 0s - loss: 0.0716 - accuracy: 0.9636
49/80 [=================>............] - ETA: 0s - loss: 0.0734 - accuracy: 0.9620
53/80 [==================>...........] - ETA: 0s - loss: 0.0712 - accuracy: 0.9630
57/80 [====================>.........] - ETA: 0s - loss: 0.0735 - accuracy: 0.9612
61/80 [=====================>........] - ETA: 0s - loss: 0.0732 - accuracy: 0.9618
65/80 [=======================>......] - ETA: 0s - loss: 0.0748 - accuracy: 0.9612
69/80 [========================>.....] - ETA: 0s - loss: 0.0762 - accuracy: 0.9609
73/80 [==========================>...] - ETA: 0s - loss: 0.0769 - accuracy: 0.9607
77/80 [===========================>..] - ETA: 0s - loss: 0.0763 - accuracy: 0.9608
80/80 [==============================] - 1s 15ms/step - loss: 0.0786 - accuracy: 0.9600

80/80 [==============================] - 1s 18ms/step - loss: 0.0786 - accuracy: 0.9600 - val_loss: 1.8177 - val_accuracy: 0.7720
Epoch 44/50

 1/80 [..............................] - ETA: 0s - loss: 0.0406 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.0565 - accuracy: 0.9720
 9/80 [==>...........................] - ETA: 0s - loss: 0.0692 - accuracy: 0.9678
13/80 [===>..........................] - ETA: 0s - loss: 0.0697 - accuracy: 0.9662
17/80 [=====>........................] - ETA: 0s - loss: 0.0659 - accuracy: 0.9682
21/80 [======>.......................] - ETA: 0s - loss: 0.0658 - accuracy: 0.9671
25/80 [========>.....................] - ETA: 0s - loss: 0.0654 - accuracy: 0.9672
29/80 [=========>....................] - ETA: 0s - loss: 0.0659 - accuracy: 0.9672
33/80 [===========>..................] - ETA: 0s - loss: 0.0668 - accuracy: 0.9673
37/80 [============>.................] - ETA: 0s - loss: 0.0670 - accuracy: 0.9665
41/80 [==============>...............] - ETA: 0s - loss: 0.0661 - accuracy: 0.9673
45/80 [===============>..............] - ETA: 0s - loss: 0.0688 - accuracy: 0.9656
49/80 [=================>............] - ETA: 0s - loss: 0.0695 - accuracy: 0.9655
53/80 [==================>...........] - ETA: 0s - loss: 0.0689 - accuracy: 0.9660
57/80 [====================>.........] - ETA: 0s - loss: 0.0689 - accuracy: 0.9658
61/80 [=====================>........] - ETA: 0s - loss: 0.0697 - accuracy: 0.9654
65/80 [=======================>......] - ETA: 0s - loss: 0.0721 - accuracy: 0.9645
69/80 [========================>.....] - ETA: 0s - loss: 0.0715 - accuracy: 0.9646
73/80 [==========================>...] - ETA: 0s - loss: 0.0727 - accuracy: 0.9637
77/80 [===========================>..] - ETA: 0s - loss: 0.0735 - accuracy: 0.9631
80/80 [==============================] - 1s 15ms/step - loss: 0.0740 - accuracy: 0.9623

80/80 [==============================] - 1s 18ms/step - loss: 0.0740 - accuracy: 0.9623 - val_loss: 1.8535 - val_accuracy: 0.7720
Epoch 45/50

 1/80 [..............................] - ETA: 0s - loss: 0.0962 - accuracy: 0.9600
 5/80 [>.............................] - ETA: 0s - loss: 0.0682 - accuracy: 0.9700
 9/80 [==>...........................] - ETA: 0s - loss: 0.0746 - accuracy: 0.9678
13/80 [===>..........................] - ETA: 0s - loss: 0.0671 - accuracy: 0.9700
17/80 [=====>........................] - ETA: 0s - loss: 0.0705 - accuracy: 0.9659
21/80 [======>.......................] - ETA: 0s - loss: 0.0686 - accuracy: 0.9657
25/80 [========>.....................] - ETA: 0s - loss: 0.0675 - accuracy: 0.9656
29/80 [=========>....................] - ETA: 0s - loss: 0.0678 - accuracy: 0.9645
33/80 [===========>..................] - ETA: 0s - loss: 0.0719 - accuracy: 0.9624
37/80 [============>.................] - ETA: 0s - loss: 0.0694 - accuracy: 0.9632
41/80 [==============>...............] - ETA: 0s - loss: 0.0712 - accuracy: 0.9620
45/80 [===============>..............] - ETA: 0s - loss: 0.0699 - accuracy: 0.9620
49/80 [=================>............] - ETA: 0s - loss: 0.0699 - accuracy: 0.9618
53/80 [==================>...........] - ETA: 0s - loss: 0.0688 - accuracy: 0.9625
57/80 [====================>.........] - ETA: 0s - loss: 0.0685 - accuracy: 0.9630
61/80 [=====================>........] - ETA: 0s - loss: 0.0699 - accuracy: 0.9626
65/80 [=======================>......] - ETA: 0s - loss: 0.0700 - accuracy: 0.9620
69/80 [========================>.....] - ETA: 0s - loss: 0.0695 - accuracy: 0.9617
72/80 [==========================>...] - ETA: 0s - loss: 0.0684 - accuracy: 0.9621
75/80 [===========================>..] - ETA: 0s - loss: 0.0678 - accuracy: 0.9620
79/80 [============================>.] - ETA: 0s - loss: 0.0682 - accuracy: 0.9618
80/80 [==============================] - 1s 16ms/step - loss: 0.0683 - accuracy: 0.9617

80/80 [==============================] - 1s 18ms/step - loss: 0.0683 - accuracy: 0.9617 - val_loss: 1.9112 - val_accuracy: 0.7750
Epoch 46/50

 1/80 [..............................] - ETA: 0s - loss: 0.0458 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.0394 - accuracy: 0.9760
 9/80 [==>...........................] - ETA: 0s - loss: 0.0551 - accuracy: 0.9711
13/80 [===>..........................] - ETA: 0s - loss: 0.0547 - accuracy: 0.9723
17/80 [=====>........................] - ETA: 0s - loss: 0.0499 - accuracy: 0.9747
21/80 [======>.......................] - ETA: 0s - loss: 0.0565 - accuracy: 0.9695
24/80 [========>.....................] - ETA: 0s - loss: 0.0593 - accuracy: 0.9688
28/80 [=========>....................] - ETA: 0s - loss: 0.0558 - accuracy: 0.9711
32/80 [===========>..................] - ETA: 0s - loss: 0.0574 - accuracy: 0.9694
36/80 [============>.................] - ETA: 0s - loss: 0.0610 - accuracy: 0.9675
40/80 [==============>...............] - ETA: 0s - loss: 0.0619 - accuracy: 0.9660
44/80 [===============>..............] - ETA: 0s - loss: 0.0636 - accuracy: 0.9650
48/80 [=================>............] - ETA: 0s - loss: 0.0633 - accuracy: 0.9648
52/80 [==================>...........] - ETA: 0s - loss: 0.0622 - accuracy: 0.9658
56/80 [====================>.........] - ETA: 0s - loss: 0.0631 - accuracy: 0.9654
60/80 [=====================>........] - ETA: 0s - loss: 0.0637 - accuracy: 0.9650
64/80 [=======================>......] - ETA: 0s - loss: 0.0636 - accuracy: 0.9650
68/80 [========================>.....] - ETA: 0s - loss: 0.0632 - accuracy: 0.9654
72/80 [==========================>...] - ETA: 0s - loss: 0.0636 - accuracy: 0.9654
76/80 [===========================>..] - ETA: 0s - loss: 0.0663 - accuracy: 0.9641
80/80 [==============================] - 1s 15ms/step - loss: 0.0666 - accuracy: 0.9640

80/80 [==============================] - 1s 18ms/step - loss: 0.0666 - accuracy: 0.9640 - val_loss: 1.9755 - val_accuracy: 0.7790
Epoch 47/50

 1/80 [..............................] - ETA: 0s - loss: 0.0684 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.0550 - accuracy: 0.9720
 9/80 [==>...........................] - ETA: 0s - loss: 0.0523 - accuracy: 0.9711
13/80 [===>..........................] - ETA: 0s - loss: 0.0618 - accuracy: 0.9662
17/80 [=====>........................] - ETA: 0s - loss: 0.0648 - accuracy: 0.9629
21/80 [======>.......................] - ETA: 0s - loss: 0.0635 - accuracy: 0.9614
25/80 [========>.....................] - ETA: 0s - loss: 0.0638 - accuracy: 0.9612
29/80 [=========>....................] - ETA: 0s - loss: 0.0631 - accuracy: 0.9624
33/80 [===========>..................] - ETA: 0s - loss: 0.0657 - accuracy: 0.9609
37/80 [============>.................] - ETA: 0s - loss: 0.0639 - accuracy: 0.9622
41/80 [==============>...............] - ETA: 0s - loss: 0.0641 - accuracy: 0.9627
45/80 [===============>..............] - ETA: 0s - loss: 0.0644 - accuracy: 0.9631
49/80 [=================>............] - ETA: 0s - loss: 0.0641 - accuracy: 0.9631
53/80 [==================>...........] - ETA: 0s - loss: 0.0628 - accuracy: 0.9642
57/80 [====================>.........] - ETA: 0s - loss: 0.0628 - accuracy: 0.9637
60/80 [=====================>........] - ETA: 0s - loss: 0.0625 - accuracy: 0.9637
64/80 [=======================>......] - ETA: 0s - loss: 0.0621 - accuracy: 0.9639
67/80 [========================>.....] - ETA: 0s - loss: 0.0628 - accuracy: 0.9636
71/80 [=========================>....] - ETA: 0s - loss: 0.0646 - accuracy: 0.9631
75/80 [===========================>..] - ETA: 0s - loss: 0.0673 - accuracy: 0.9616
79/80 [============================>.] - ETA: 0s - loss: 0.0665 - accuracy: 0.9619
80/80 [==============================] - 1s 16ms/step - loss: 0.0673 - accuracy: 0.9613

80/80 [==============================] - 1s 18ms/step - loss: 0.0673 - accuracy: 0.9613 - val_loss: 2.0420 - val_accuracy: 0.7800
Epoch 48/50

 1/80 [..............................] - ETA: 0s - loss: 0.0892 - accuracy: 0.9400
 5/80 [>.............................] - ETA: 0s - loss: 0.0618 - accuracy: 0.9660
 9/80 [==>...........................] - ETA: 0s - loss: 0.0547 - accuracy: 0.9711
13/80 [===>..........................] - ETA: 0s - loss: 0.0590 - accuracy: 0.9654
17/80 [=====>........................] - ETA: 0s - loss: 0.0644 - accuracy: 0.9618
21/80 [======>.......................] - ETA: 0s - loss: 0.0637 - accuracy: 0.9619
25/80 [========>.....................] - ETA: 0s - loss: 0.0643 - accuracy: 0.9616
29/80 [=========>....................] - ETA: 0s - loss: 0.0616 - accuracy: 0.9634
33/80 [===========>..................] - ETA: 0s - loss: 0.0609 - accuracy: 0.9648
37/80 [============>.................] - ETA: 0s - loss: 0.0667 - accuracy: 0.9630
41/80 [==============>...............] - ETA: 0s - loss: 0.0663 - accuracy: 0.9622
45/80 [===============>..............] - ETA: 0s - loss: 0.0666 - accuracy: 0.9616
49/80 [=================>............] - ETA: 0s - loss: 0.0675 - accuracy: 0.9616
53/80 [==================>...........] - ETA: 0s - loss: 0.0685 - accuracy: 0.9619
56/80 [====================>.........] - ETA: 0s - loss: 0.0677 - accuracy: 0.9623
60/80 [=====================>........] - ETA: 0s - loss: 0.0677 - accuracy: 0.9625
64/80 [=======================>......] - ETA: 0s - loss: 0.0679 - accuracy: 0.9623
68/80 [========================>.....] - ETA: 0s - loss: 0.0678 - accuracy: 0.9621
72/80 [==========================>...] - ETA: 0s - loss: 0.0672 - accuracy: 0.9624
76/80 [===========================>..] - ETA: 0s - loss: 0.0667 - accuracy: 0.9625
80/80 [==============================] - 1s 15ms/step - loss: 0.0660 - accuracy: 0.9630

80/80 [==============================] - 1s 18ms/step - loss: 0.0660 - accuracy: 0.9630 - val_loss: 2.0011 - val_accuracy: 0.7840
Epoch 49/50

 1/80 [..............................] - ETA: 0s - loss: 0.0444 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.0538 - accuracy: 0.9720
 9/80 [==>...........................] - ETA: 0s - loss: 0.0547 - accuracy: 0.9689
13/80 [===>..........................] - ETA: 0s - loss: 0.0554 - accuracy: 0.9677
17/80 [=====>........................] - ETA: 0s - loss: 0.0592 - accuracy: 0.9647
21/80 [======>.......................] - ETA: 0s - loss: 0.0571 - accuracy: 0.9667
24/80 [========>.....................] - ETA: 0s - loss: 0.0607 - accuracy: 0.9663
28/80 [=========>....................] - ETA: 0s - loss: 0.0639 - accuracy: 0.9646
32/80 [===========>..................] - ETA: 0s - loss: 0.0660 - accuracy: 0.9634
36/80 [============>.................] - ETA: 0s - loss: 0.0650 - accuracy: 0.9639
39/80 [=============>................] - ETA: 0s - loss: 0.0632 - accuracy: 0.9644
43/80 [===============>..............] - ETA: 0s - loss: 0.0616 - accuracy: 0.9644
47/80 [================>.............] - ETA: 0s - loss: 0.0606 - accuracy: 0.9647
51/80 [==================>...........] - ETA: 0s - loss: 0.0598 - accuracy: 0.9651
55/80 [===================>..........] - ETA: 0s - loss: 0.0589 - accuracy: 0.9658
59/80 [=====================>........] - ETA: 0s - loss: 0.0592 - accuracy: 0.9654
63/80 [======================>.......] - ETA: 0s - loss: 0.0590 - accuracy: 0.9657
66/80 [=======================>......] - ETA: 0s - loss: 0.0589 - accuracy: 0.9659
70/80 [=========================>....] - ETA: 0s - loss: 0.0604 - accuracy: 0.9644
74/80 [==========================>...] - ETA: 0s - loss: 0.0625 - accuracy: 0.9631
78/80 [============================>.] - ETA: 0s - loss: 0.0627 - accuracy: 0.9632
80/80 [==============================] - 1s 15ms/step - loss: 0.0626 - accuracy: 0.9629

80/80 [==============================] - 1s 18ms/step - loss: 0.0626 - accuracy: 0.9629 - val_loss: 2.0303 - val_accuracy: 0.7820
Epoch 50/50

 1/80 [..............................] - ETA: 0s - loss: 0.0695 - accuracy: 0.9700
 5/80 [>.............................] - ETA: 0s - loss: 0.0478 - accuracy: 0.9740
 9/80 [==>...........................] - ETA: 0s - loss: 0.0412 - accuracy: 0.9756
13/80 [===>..........................] - ETA: 0s - loss: 0.0556 - accuracy: 0.9669
17/80 [=====>........................] - ETA: 0s - loss: 0.0608 - accuracy: 0.9629
21/80 [======>.......................] - ETA: 0s - loss: 0.0565 - accuracy: 0.9657
25/80 [========>.....................] - ETA: 0s - loss: 0.0605 - accuracy: 0.9632
29/80 [=========>....................] - ETA: 0s - loss: 0.0618 - accuracy: 0.9628
33/80 [===========>..................] - ETA: 0s - loss: 0.0616 - accuracy: 0.9636
37/80 [============>.................] - ETA: 0s - loss: 0.0584 - accuracy: 0.9654
41/80 [==============>...............] - ETA: 0s - loss: 0.0585 - accuracy: 0.9649
45/80 [===============>..............] - ETA: 0s - loss: 0.0583 - accuracy: 0.9647
49/80 [=================>............] - ETA: 0s - loss: 0.0580 - accuracy: 0.9645
53/80 [==================>...........] - ETA: 0s - loss: 0.0599 - accuracy: 0.9636
57/80 [====================>.........] - ETA: 0s - loss: 0.0604 - accuracy: 0.9632
61/80 [=====================>........] - ETA: 0s - loss: 0.0612 - accuracy: 0.9626
65/80 [=======================>......] - ETA: 0s - loss: 0.0621 - accuracy: 0.9626
68/80 [========================>.....] - ETA: 0s - loss: 0.0629 - accuracy: 0.9619
71/80 [=========================>....] - ETA: 0s - loss: 0.0636 - accuracy: 0.9614
75/80 [===========================>..] - ETA: 0s - loss: 0.0653 - accuracy: 0.9605
79/80 [============================>.] - ETA: 0s - loss: 0.0646 - accuracy: 0.9606
80/80 [==============================] - 1s 15ms/step - loss: 0.0643 - accuracy: 0.9608

80/80 [==============================] - 1s 18ms/step - loss: 0.0643 - accuracy: 0.9608 - val_loss: 2.0082 - val_accuracy: 0.7840

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-01T18-48-42Z

Training run 5/8 (flags = list(392, 0.05, 1000, 100, "tanh")) 
Using run directory runs/2020-11-01T18-50-06Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = 10000) %>%
+         layer_dense( units = FLAGS$n .... [TRUNCATED] 

> set.seed(123)

> model %>% compile (
+         loss = 'sparse_categorical_crossentropy',
+         optimizer = optimizer_adam(lr=FLAGS$learning_rate),
+         metr .... [TRUNCATED] 

> model %>% fit (x = reuters_train, y = reuters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = list(reuters_val .... [TRUNCATED] 
Epoch 1/100

1/8 [==>...........................] - ETA: 0s - loss: 3.8321 - accuracy: 0.0150
2/8 [======>.......................] - ETA: 0s - loss: 4.8449 - accuracy: 0.2415
3/8 [==========>...................] - ETA: 0s - loss: 7.3957 - accuracy: 0.1613
4/8 [==============>...............] - ETA: 0s - loss: 6.8826 - accuracy: 0.1235
5/8 [=================>............] - ETA: 0s - loss: 6.5931 - accuracy: 0.1688
6/8 [=====================>........] - ETA: 0s - loss: 6.6991 - accuracy: 0.1763
7/8 [=========================>....] - ETA: 0s - loss: 7.5349 - accuracy: 0.1609
8/8 [==============================] - 1s 68ms/step - loss: 8.8084 - accuracy: 0.1483

8/8 [==============================] - 1s 152ms/step - loss: 8.8084 - accuracy: 0.1483 - val_loss: 22.4245 - val_accuracy: 0.0040
Epoch 2/100

1/8 [==>...........................] - ETA: 0s - loss: 21.7160 - accuracy: 0.0130
2/8 [======>.......................] - ETA: 0s - loss: 22.3330 - accuracy: 0.0095
3/8 [==========>...................] - ETA: 0s - loss: 23.1354 - accuracy: 0.0180
4/8 [==============>...............] - ETA: 0s - loss: 24.5562 - accuracy: 0.1013
5/8 [=================>............] - ETA: 0s - loss: 26.1899 - accuracy: 0.0810
6/8 [=====================>........] - ETA: 0s - loss: 27.2863 - accuracy: 0.1257
7/8 [=========================>....] - ETA: 0s - loss: 28.1806 - accuracy: 0.1084
8/8 [==============================] - 1s 70ms/step - loss: 28.6005 - accuracy: 0.0953

8/8 [==============================] - 1s 91ms/step - loss: 28.6005 - accuracy: 0.0953 - val_loss: 31.2488 - val_accuracy: 0.0460
Epoch 3/100

1/8 [==>...........................] - ETA: 0s - loss: 30.9950 - accuracy: 0.0510
2/8 [======>.......................] - ETA: 0s - loss: 30.4588 - accuracy: 0.0430
3/8 [==========>...................] - ETA: 0s - loss: 30.0345 - accuracy: 0.1483
4/8 [==============>...............] - ETA: 0s - loss: 29.4759 - accuracy: 0.1992
5/8 [=================>............] - ETA: 0s - loss: 31.0928 - accuracy: 0.2022
6/8 [=====================>........] - ETA: 0s - loss: 31.7813 - accuracy: 0.2083
7/8 [=========================>....] - ETA: 0s - loss: 32.0609 - accuracy: 0.2066
8/8 [==============================] - 1s 65ms/step - loss: 32.2191 - accuracy: 0.2217

8/8 [==============================] - 1s 86ms/step - loss: 32.2191 - accuracy: 0.2217 - val_loss: 30.3994 - val_accuracy: 0.3540
Epoch 4/100

1/8 [==>...........................] - ETA: 0s - loss: 30.9130 - accuracy: 0.3440
2/8 [======>.......................] - ETA: 0s - loss: 31.4086 - accuracy: 0.1765
3/8 [==========>...................] - ETA: 0s - loss: 31.2819 - accuracy: 0.1253
4/8 [==============>...............] - ETA: 0s - loss: 30.4299 - accuracy: 0.1098
5/8 [=================>............] - ETA: 0s - loss: 29.5524 - accuracy: 0.1576
6/8 [=====================>........] - ETA: 0s - loss: 28.5036 - accuracy: 0.1917
7/8 [=========================>....] - ETA: 0s - loss: 27.8195 - accuracy: 0.1647
8/8 [==============================] - 1s 67ms/step - loss: 28.2170 - accuracy: 0.1503

8/8 [==============================] - 1s 88ms/step - loss: 28.2170 - accuracy: 0.1503 - val_loss: 28.9491 - val_accuracy: 0.0000e+00
Epoch 5/100

1/8 [==>...........................] - ETA: 0s - loss: 28.3530 - accuracy: 0.0010
2/8 [======>.......................] - ETA: 0s - loss: 27.0161 - accuracy: 0.1045
3/8 [==========>...................] - ETA: 0s - loss: 26.6499 - accuracy: 0.0847
4/8 [==============>...............] - ETA: 0s - loss: 26.1922 - accuracy: 0.1185
5/8 [=================>............] - ETA: 0s - loss: 26.0766 - accuracy: 0.1670
6/8 [=====================>........] - ETA: 0s - loss: 26.2104 - accuracy: 0.1938
7/8 [=========================>....] - ETA: 0s - loss: 26.5958 - accuracy: 0.1664
8/8 [==============================] - 1s 67ms/step - loss: 26.4051 - accuracy: 0.1887

8/8 [==============================] - 1s 89ms/step - loss: 26.4051 - accuracy: 0.1887 - val_loss: 23.2508 - val_accuracy: 0.0000e+00
Epoch 6/100

1/8 [==>...........................] - ETA: 0s - loss: 20.1200 - accuracy: 0.0030
2/8 [======>.......................] - ETA: 0s - loss: 20.8149 - accuracy: 0.1740
3/8 [==========>...................] - ETA: 0s - loss: 21.0960 - accuracy: 0.1863
4/8 [==============>...............] - ETA: 0s - loss: 21.5912 - accuracy: 0.1423
5/8 [=================>............] - ETA: 0s - loss: 21.2193 - accuracy: 0.1830
6/8 [=====================>........] - ETA: 0s - loss: 20.8271 - accuracy: 0.1547
7/8 [=========================>....] - ETA: 0s - loss: 20.5997 - accuracy: 0.1389
8/8 [==============================] - 1s 69ms/step - loss: 20.6263 - accuracy: 0.1630

8/8 [==============================] - 1s 91ms/step - loss: 20.6263 - accuracy: 0.1630 - val_loss: 19.8904 - val_accuracy: 0.0170
Epoch 7/100

1/8 [==>...........................] - ETA: 0s - loss: 19.7418 - accuracy: 0.0110
2/8 [======>.......................] - ETA: 0s - loss: 20.2444 - accuracy: 0.1060
3/8 [==========>...................] - ETA: 0s - loss: 19.9509 - accuracy: 0.1423
4/8 [==============>...............] - ETA: 0s - loss: 19.9748 - accuracy: 0.1937
5/8 [=================>............] - ETA: 0s - loss: 20.1867 - accuracy: 0.1632
6/8 [=====================>........] - ETA: 0s - loss: 19.7510 - accuracy: 0.1472
7/8 [=========================>....] - ETA: 0s - loss: 19.5387 - accuracy: 0.1760
8/8 [==============================] - 1s 71ms/step - loss: 19.6324 - accuracy: 0.1771

8/8 [==============================] - 1s 94ms/step - loss: 19.6324 - accuracy: 0.1771 - val_loss: 20.7876 - val_accuracy: 0.0080
Epoch 8/100

1/8 [==>...........................] - ETA: 0s - loss: 20.9113 - accuracy: 0.0080
2/8 [======>.......................] - ETA: 0s - loss: 21.3835 - accuracy: 0.1685
3/8 [==========>...................] - ETA: 0s - loss: 20.5747 - accuracy: 0.2190
4/8 [==============>...............] - ETA: 0s - loss: 20.4005 - accuracy: 0.2173
5/8 [=================>............] - ETA: 0s - loss: 20.0521 - accuracy: 0.1800
6/8 [=====================>........] - ETA: 0s - loss: 19.9284 - accuracy: 0.2080
7/8 [=========================>....] - ETA: 0s - loss: 19.7607 - accuracy: 0.2303
8/8 [==============================] - 1s 71ms/step - loss: 19.3598 - accuracy: 0.2278

8/8 [==============================] - 1s 94ms/step - loss: 19.3598 - accuracy: 0.2278 - val_loss: 16.3950 - val_accuracy: 0.2220
Epoch 9/100

1/8 [==>...........................] - ETA: 0s - loss: 16.1022 - accuracy: 0.2140
2/8 [======>.......................] - ETA: 0s - loss: 16.5948 - accuracy: 0.1430
3/8 [==========>...................] - ETA: 0s - loss: 16.6713 - accuracy: 0.0990
4/8 [==============>...............] - ETA: 0s - loss: 16.4594 - accuracy: 0.1667
5/8 [=================>............] - ETA: 0s - loss: 16.5145 - accuracy: 0.1358
6/8 [=====================>........] - ETA: 0s - loss: 16.4407 - accuracy: 0.1220
7/8 [=========================>....] - ETA: 0s - loss: 16.4222 - accuracy: 0.1340
8/8 [==============================] - 1s 74ms/step - loss: 16.4906 - accuracy: 0.1621

8/8 [==============================] - 1s 97ms/step - loss: 16.4906 - accuracy: 0.1621 - val_loss: 15.6837 - val_accuracy: 0.3540
Epoch 10/100

1/8 [==>...........................] - ETA: 0s - loss: 16.0872 - accuracy: 0.3580
2/8 [======>.......................] - ETA: 0s - loss: 16.5539 - accuracy: 0.3560
3/8 [==========>...................] - ETA: 0s - loss: 16.7432 - accuracy: 0.2387
4/8 [==============>...............] - ETA: 0s - loss: 16.3580 - accuracy: 0.2362
5/8 [=================>............] - ETA: 0s - loss: 15.7539 - accuracy: 0.2622
6/8 [=====================>........] - ETA: 0s - loss: 15.2726 - accuracy: 0.2743
7/8 [=========================>....] - ETA: 0s - loss: 15.0968 - accuracy: 0.2389
8/8 [==============================] - 1s 72ms/step - loss: 14.7883 - accuracy: 0.2152

8/8 [==============================] - 1s 94ms/step - loss: 14.7883 - accuracy: 0.2152 - val_loss: 12.1007 - val_accuracy: 0.0150
Epoch 11/100

1/8 [==>...........................] - ETA: 0s - loss: 12.0820 - accuracy: 0.0100
2/8 [======>.......................] - ETA: 0s - loss: 12.6169 - accuracy: 0.1665
3/8 [==========>...................] - ETA: 0s - loss: 12.5148 - accuracy: 0.2277
4/8 [==============>...............] - ETA: 0s - loss: 13.0264 - accuracy: 0.2250
5/8 [=================>............] - ETA: 0s - loss: 12.9108 - accuracy: 0.2534
6/8 [=====================>........] - ETA: 0s - loss: 13.1248 - accuracy: 0.2687
7/8 [=========================>....] - ETA: 0s - loss: 13.0825 - accuracy: 0.2366
8/8 [==============================] - 1s 74ms/step - loss: 13.0093 - accuracy: 0.2152

8/8 [==============================] - 1s 97ms/step - loss: 13.0093 - accuracy: 0.2152 - val_loss: 11.3610 - val_accuracy: 0.3540
Epoch 12/100

1/8 [==>...........................] - ETA: 0s - loss: 12.2234 - accuracy: 0.3320
2/8 [======>.......................] - ETA: 0s - loss: 11.5714 - accuracy: 0.1915
3/8 [==========>...................] - ETA: 0s - loss: 11.6765 - accuracy: 0.2387
4/8 [==============>...............] - ETA: 0s - loss: 11.8229 - accuracy: 0.2680
5/8 [=================>............] - ETA: 0s - loss: 11.6234 - accuracy: 0.2586
6/8 [=====================>........] - ETA: 0s - loss: 11.4054 - accuracy: 0.2782
7/8 [=========================>....] - ETA: 0s - loss: 11.4011 - accuracy: 0.2863
8/8 [==============================] - 1s 77ms/step - loss: 11.0824 - accuracy: 0.2558

8/8 [==============================] - 1s 99ms/step - loss: 11.0824 - accuracy: 0.2558 - val_loss: 9.1785 - val_accuracy: 0.3540
Epoch 13/100

1/8 [==>...........................] - ETA: 0s - loss: 8.5319 - accuracy: 0.3750
2/8 [======>.......................] - ETA: 0s - loss: 9.4145 - accuracy: 0.2175
3/8 [==========>...................] - ETA: 0s - loss: 9.4528 - accuracy: 0.2647
4/8 [==============>...............] - ETA: 0s - loss: 8.9857 - accuracy: 0.2865
5/8 [=================>............] - ETA: 0s - loss: 9.1326 - accuracy: 0.3032
6/8 [=====================>........] - ETA: 0s - loss: 9.2137 - accuracy: 0.3068
7/8 [=========================>....] - ETA: 0s - loss: 9.1292 - accuracy: 0.3109
8/8 [==============================] - 1s 75ms/step - loss: 9.1280 - accuracy: 0.2808

8/8 [==============================] - 1s 97ms/step - loss: 9.1280 - accuracy: 0.2808 - val_loss: 8.0482 - val_accuracy: 0.2220
Epoch 14/100

1/8 [==>...........................] - ETA: 0s - loss: 9.0786 - accuracy: 0.2040
2/8 [======>.......................] - ETA: 0s - loss: 8.7237 - accuracy: 0.2805
3/8 [==========>...................] - ETA: 0s - loss: 8.5194 - accuracy: 0.3057
4/8 [==============>...............] - ETA: 0s - loss: 8.1716 - accuracy: 0.2775
5/8 [=================>............] - ETA: 0s - loss: 8.1062 - accuracy: 0.2314
6/8 [=====================>........] - ETA: 0s - loss: 7.9024 - accuracy: 0.2485
7/8 [=========================>....] - ETA: 0s - loss: 7.9220 - accuracy: 0.2434
8/8 [==============================] - 1s 75ms/step - loss: 7.7103 - accuracy: 0.2410

8/8 [==============================] - 1s 99ms/step - loss: 7.7103 - accuracy: 0.2410 - val_loss: 6.9044 - val_accuracy: 0.3540
Epoch 15/100

1/8 [==>...........................] - ETA: 0s - loss: 6.9596 - accuracy: 0.3510
2/8 [======>.......................] - ETA: 0s - loss: 7.0635 - accuracy: 0.3630
3/8 [==========>...................] - ETA: 0s - loss: 7.0965 - accuracy: 0.3163
4/8 [==============>...............] - ETA: 0s - loss: 6.9068 - accuracy: 0.2873
5/8 [=================>............] - ETA: 0s - loss: 6.7706 - accuracy: 0.2956
6/8 [=====================>........] - ETA: 0s - loss: 6.6183 - accuracy: 0.3045
7/8 [=========================>....] - ETA: 0s - loss: 6.4769 - accuracy: 0.2679
8/8 [==============================] - 1s 76ms/step - loss: 6.3501 - accuracy: 0.2627

8/8 [==============================] - 1s 100ms/step - loss: 6.3501 - accuracy: 0.2627 - val_loss: 5.5203 - val_accuracy: 0.3540
Epoch 16/100

1/8 [==>...........................] - ETA: 0s - loss: 5.3169 - accuracy: 0.3570
2/8 [======>.......................] - ETA: 0s - loss: 5.6498 - accuracy: 0.3505
3/8 [==========>...................] - ETA: 0s - loss: 5.6446 - accuracy: 0.2380
4/8 [==============>...............] - ETA: 0s - loss: 5.5619 - accuracy: 0.2655
5/8 [=================>............] - ETA: 0s - loss: 5.4311 - accuracy: 0.2852
6/8 [=====================>........] - ETA: 0s - loss: 5.3882 - accuracy: 0.2942
7/8 [=========================>....] - ETA: 0s - loss: 5.2653 - accuracy: 0.3024
8/8 [==============================] - 1s 77ms/step - loss: 5.2225 - accuracy: 0.3092

8/8 [==============================] - 1s 100ms/step - loss: 5.2225 - accuracy: 0.3092 - val_loss: 4.4195 - val_accuracy: 0.3540
Epoch 17/100

1/8 [==>...........................] - ETA: 0s - loss: 5.1516 - accuracy: 0.3680
2/8 [======>.......................] - ETA: 0s - loss: 4.8316 - accuracy: 0.3615
3/8 [==========>...................] - ETA: 0s - loss: 4.7762 - accuracy: 0.3093
4/8 [==============>...............] - ETA: 0s - loss: 4.8522 - accuracy: 0.3140
5/8 [=================>............] - ETA: 0s - loss: 4.7077 - accuracy: 0.3192
6/8 [=====================>........] - ETA: 0s - loss: 4.6297 - accuracy: 0.3015
7/8 [=========================>....] - ETA: 0s - loss: 4.6042 - accuracy: 0.2883
8/8 [==============================] - 1s 75ms/step - loss: 4.4654 - accuracy: 0.2939

8/8 [==============================] - 1s 99ms/step - loss: 4.4654 - accuracy: 0.2939 - val_loss: 3.7079 - val_accuracy: 0.3540
Epoch 18/100

1/8 [==>...........................] - ETA: 0s - loss: 3.8463 - accuracy: 0.3560
2/8 [======>.......................] - ETA: 0s - loss: 3.5917 - accuracy: 0.2870
3/8 [==========>...................] - ETA: 0s - loss: 3.6381 - accuracy: 0.3067
4/8 [==============>...............] - ETA: 0s - loss: 3.6601 - accuracy: 0.3225
5/8 [=================>............] - ETA: 0s - loss: 3.6847 - accuracy: 0.3238
6/8 [=====================>........] - ETA: 0s - loss: 3.6498 - accuracy: 0.3073
7/8 [=========================>....] - ETA: 0s - loss: 3.6380 - accuracy: 0.3154
8/8 [==============================] - 1s 80ms/step - loss: 3.7003 - accuracy: 0.3191

8/8 [==============================] - 1s 104ms/step - loss: 3.7003 - accuracy: 0.3191 - val_loss: 3.6325 - val_accuracy: 0.3540
Epoch 19/100

1/8 [==>...........................] - ETA: 0s - loss: 4.0847 - accuracy: 0.3280
2/8 [======>.......................] - ETA: 0s - loss: 4.1628 - accuracy: 0.2775
3/8 [==========>...................] - ETA: 0s - loss: 4.0069 - accuracy: 0.3033
4/8 [==============>...............] - ETA: 0s - loss: 3.9569 - accuracy: 0.3200
5/8 [=================>............] - ETA: 0s - loss: 3.8663 - accuracy: 0.3306
6/8 [=====================>........] - ETA: 0s - loss: 3.8095 - accuracy: 0.3138
7/8 [=========================>....] - ETA: 0s - loss: 3.7760 - accuracy: 0.3181
8/8 [==============================] - 1s 74ms/step - loss: 3.7159 - accuracy: 0.3226

8/8 [==============================] - 1s 96ms/step - loss: 3.7159 - accuracy: 0.3226 - val_loss: 3.5178 - val_accuracy: 0.3540
Epoch 20/100

1/8 [==>...........................] - ETA: 0s - loss: 3.1426 - accuracy: 0.3390
2/8 [======>.......................] - ETA: 0s - loss: 3.5363 - accuracy: 0.2800
3/8 [==========>...................] - ETA: 0s - loss: 3.5510 - accuracy: 0.3117
4/8 [==============>...............] - ETA: 0s - loss: 3.6562 - accuracy: 0.3167
5/8 [=================>............] - ETA: 0s - loss: 3.6874 - accuracy: 0.2934
6/8 [=====================>........] - ETA: 0s - loss: 3.6632 - accuracy: 0.2995
7/8 [=========================>....] - ETA: 0s - loss: 3.6633 - accuracy: 0.3094
8/8 [==============================] - 1s 75ms/step - loss: 3.6722 - accuracy: 0.3145

8/8 [==============================] - 1s 98ms/step - loss: 3.6722 - accuracy: 0.3145 - val_loss: 3.4233 - val_accuracy: 0.2220
Epoch 21/100

1/8 [==>...........................] - ETA: 0s - loss: 3.4658 - accuracy: 0.2010
2/8 [======>.......................] - ETA: 0s - loss: 3.7453 - accuracy: 0.2745
3/8 [==========>...................] - ETA: 0s - loss: 3.6885 - accuracy: 0.2987
4/8 [==============>...............] - ETA: 0s - loss: 3.5345 - accuracy: 0.3165
5/8 [=================>............] - ETA: 0s - loss: 3.5589 - accuracy: 0.3210
6/8 [=====================>........] - ETA: 0s - loss: 3.4934 - accuracy: 0.3253
7/8 [=========================>....] - ETA: 0s - loss: 3.4418 - accuracy: 0.3294
8/8 [==============================] - 1s 77ms/step - loss: 3.4267 - accuracy: 0.3314

8/8 [==============================] - 1s 101ms/step - loss: 3.4267 - accuracy: 0.3314 - val_loss: 3.1710 - val_accuracy: 0.3540
Epoch 22/100

1/8 [==>...........................] - ETA: 0s - loss: 3.2360 - accuracy: 0.3370
2/8 [======>.......................] - ETA: 0s - loss: 3.1001 - accuracy: 0.3415
3/8 [==========>...................] - ETA: 0s - loss: 3.0446 - accuracy: 0.3390
4/8 [==============>...............] - ETA: 0s - loss: 3.0412 - accuracy: 0.3453
5/8 [=================>............] - ETA: 0s - loss: 3.1317 - accuracy: 0.3478
6/8 [=====================>........] - ETA: 0s - loss: 3.0873 - accuracy: 0.3495
7/8 [=========================>....] - ETA: 0s - loss: 3.0858 - accuracy: 0.3533
8/8 [==============================] - 1s 78ms/step - loss: 3.1001 - accuracy: 0.3514

8/8 [==============================] - 1s 101ms/step - loss: 3.1001 - accuracy: 0.3514 - val_loss: 3.0568 - val_accuracy: 0.3540
Epoch 23/100

1/8 [==>...........................] - ETA: 0s - loss: 3.0182 - accuracy: 0.3710
2/8 [======>.......................] - ETA: 0s - loss: 2.9047 - accuracy: 0.3765
3/8 [==========>...................] - ETA: 0s - loss: 2.8782 - accuracy: 0.3617
4/8 [==============>...............] - ETA: 0s - loss: 2.8798 - accuracy: 0.3225
5/8 [=================>............] - ETA: 0s - loss: 2.9154 - accuracy: 0.3284
6/8 [=====================>........] - ETA: 0s - loss: 2.8935 - accuracy: 0.3288
7/8 [=========================>....] - ETA: 0s - loss: 2.8670 - accuracy: 0.3157
8/8 [==============================] - 1s 78ms/step - loss: 2.8896 - accuracy: 0.3162

8/8 [==============================] - 1s 101ms/step - loss: 2.8896 - accuracy: 0.3162 - val_loss: 2.8743 - val_accuracy: 0.3540
Epoch 24/100

1/8 [==>...........................] - ETA: 0s - loss: 2.4716 - accuracy: 0.3680
2/8 [======>.......................] - ETA: 0s - loss: 2.7200 - accuracy: 0.3600
3/8 [==========>...................] - ETA: 0s - loss: 2.7549 - accuracy: 0.3110
4/8 [==============>...............] - ETA: 0s - loss: 2.7800 - accuracy: 0.3162
5/8 [=================>............] - ETA: 0s - loss: 2.7573 - accuracy: 0.3216
6/8 [=====================>........] - ETA: 0s - loss: 2.7526 - accuracy: 0.3260
7/8 [=========================>....] - ETA: 0s - loss: 2.7449 - accuracy: 0.3291
8/8 [==============================] - 1s 78ms/step - loss: 2.7498 - accuracy: 0.3312

8/8 [==============================] - 1s 102ms/step - loss: 2.7498 - accuracy: 0.3312 - val_loss: 2.8039 - val_accuracy: 0.3540
Epoch 25/100

1/8 [==>...........................] - ETA: 0s - loss: 2.8200 - accuracy: 0.3490
2/8 [======>.......................] - ETA: 0s - loss: 2.7063 - accuracy: 0.3510
3/8 [==========>...................] - ETA: 0s - loss: 2.7740 - accuracy: 0.3403
4/8 [==============>...............] - ETA: 0s - loss: 2.7650 - accuracy: 0.3072
5/8 [=================>............] - ETA: 0s - loss: 2.7683 - accuracy: 0.3162
6/8 [=====================>........] - ETA: 0s - loss: 2.7580 - accuracy: 0.3233
7/8 [=========================>....] - ETA: 0s - loss: 2.7764 - accuracy: 0.3309
8/8 [==============================] - 1s 78ms/step - loss: 2.7449 - accuracy: 0.3344

8/8 [==============================] - 1s 102ms/step - loss: 2.7449 - accuracy: 0.3344 - val_loss: 2.7753 - val_accuracy: 0.3540
Epoch 26/100

1/8 [==>...........................] - ETA: 0s - loss: 2.8018 - accuracy: 0.3700
2/8 [======>.......................] - ETA: 0s - loss: 2.7213 - accuracy: 0.3595
3/8 [==========>...................] - ETA: 0s - loss: 2.6738 - accuracy: 0.3590
4/8 [==============>...............] - ETA: 0s - loss: 2.7769 - accuracy: 0.3532
5/8 [=================>............] - ETA: 0s - loss: 2.7511 - accuracy: 0.3574
6/8 [=====================>........] - ETA: 0s - loss: 2.7325 - accuracy: 0.3550
7/8 [=========================>....] - ETA: 0s - loss: 2.7172 - accuracy: 0.3530
8/8 [==============================] - 1s 79ms/step - loss: 2.7171 - accuracy: 0.3514

8/8 [==============================] - 1s 102ms/step - loss: 2.7171 - accuracy: 0.3514 - val_loss: 2.7230 - val_accuracy: 0.3540
Epoch 27/100

1/8 [==>...........................] - ETA: 0s - loss: 2.6009 - accuracy: 0.3770
2/8 [======>.......................] - ETA: 0s - loss: 2.7344 - accuracy: 0.3715
3/8 [==========>...................] - ETA: 0s - loss: 2.7760 - accuracy: 0.3550
4/8 [==============>...............] - ETA: 0s - loss: 2.7530 - accuracy: 0.3530
5/8 [=================>............] - ETA: 0s - loss: 2.7320 - accuracy: 0.3508
6/8 [=====================>........] - ETA: 0s - loss: 2.7262 - accuracy: 0.3522
7/8 [=========================>....] - ETA: 0s - loss: 2.7082 - accuracy: 0.3511
8/8 [==============================] - 1s 79ms/step - loss: 2.7151 - accuracy: 0.3514

8/8 [==============================] - 1s 102ms/step - loss: 2.7151 - accuracy: 0.3514 - val_loss: 2.7198 - val_accuracy: 0.3540
Epoch 28/100

1/8 [==>...........................] - ETA: 0s - loss: 2.8688 - accuracy: 0.3430
2/8 [======>.......................] - ETA: 0s - loss: 2.7592 - accuracy: 0.3515
3/8 [==========>...................] - ETA: 0s - loss: 2.7622 - accuracy: 0.3527
4/8 [==============>...............] - ETA: 0s - loss: 2.7681 - accuracy: 0.3487
5/8 [=================>............] - ETA: 0s - loss: 2.7711 - accuracy: 0.3224
6/8 [=====================>........] - ETA: 0s - loss: 2.7530 - accuracy: 0.3277
7/8 [=========================>....] - ETA: 0s - loss: 2.7910 - accuracy: 0.3287
8/8 [==============================] - 1s 78ms/step - loss: 2.8018 - accuracy: 0.3315

8/8 [==============================] - 1s 102ms/step - loss: 2.8018 - accuracy: 0.3315 - val_loss: 2.6607 - val_accuracy: 0.3540
Epoch 29/100

1/8 [==>...........................] - ETA: 0s - loss: 2.9173 - accuracy: 0.3570
2/8 [======>.......................] - ETA: 0s - loss: 2.7834 - accuracy: 0.3710
3/8 [==========>...................] - ETA: 0s - loss: 2.8643 - accuracy: 0.3667
4/8 [==============>...............] - ETA: 0s - loss: 2.7800 - accuracy: 0.3598
5/8 [=================>............] - ETA: 0s - loss: 2.9015 - accuracy: 0.3558
6/8 [=====================>........] - ETA: 0s - loss: 2.8447 - accuracy: 0.3503
7/8 [=========================>....] - ETA: 0s - loss: 2.8099 - accuracy: 0.3503
8/8 [==============================] - 1s 81ms/step - loss: 2.7868 - accuracy: 0.3514

8/8 [==============================] - 1s 104ms/step - loss: 2.7868 - accuracy: 0.3514 - val_loss: 2.6453 - val_accuracy: 0.2220
Epoch 30/100

1/8 [==>...........................] - ETA: 0s - loss: 2.6969 - accuracy: 0.2200
2/8 [======>.......................] - ETA: 0s - loss: 2.7572 - accuracy: 0.2770
3/8 [==========>...................] - ETA: 0s - loss: 2.7988 - accuracy: 0.2973
4/8 [==============>...............] - ETA: 0s - loss: 2.8199 - accuracy: 0.3103
5/8 [=================>............] - ETA: 0s - loss: 2.7777 - accuracy: 0.3246
6/8 [=====================>........] - ETA: 0s - loss: 2.7478 - accuracy: 0.3270
7/8 [=========================>....] - ETA: 0s - loss: 2.7477 - accuracy: 0.3331
8/8 [==============================] - 1s 79ms/step - loss: 2.7548 - accuracy: 0.3381

8/8 [==============================] - 1s 102ms/step - loss: 2.7548 - accuracy: 0.3381 - val_loss: 2.7290 - val_accuracy: 0.3540
Epoch 31/100

1/8 [==>...........................] - ETA: 0s - loss: 2.6552 - accuracy: 0.3780
2/8 [======>.......................] - ETA: 0s - loss: 2.6844 - accuracy: 0.2980
3/8 [==========>...................] - ETA: 0s - loss: 2.7876 - accuracy: 0.3100
4/8 [==============>...............] - ETA: 0s - loss: 2.7259 - accuracy: 0.3200
5/8 [=================>............] - ETA: 0s - loss: 2.7047 - accuracy: 0.3282
6/8 [=====================>........] - ETA: 0s - loss: 2.6982 - accuracy: 0.3313
7/8 [=========================>....] - ETA: 0s - loss: 2.6733 - accuracy: 0.3349
8/8 [==============================] - 1s 79ms/step - loss: 2.7002 - accuracy: 0.3369

8/8 [==============================] - 1s 103ms/step - loss: 2.7002 - accuracy: 0.3369 - val_loss: 2.5652 - val_accuracy: 0.2220
Epoch 32/100

1/8 [==>...........................] - ETA: 0s - loss: 2.5210 - accuracy: 0.2100
2/8 [======>.......................] - ETA: 0s - loss: 2.5485 - accuracy: 0.2700
3/8 [==========>...................] - ETA: 0s - loss: 2.6469 - accuracy: 0.2520
4/8 [==============>...............] - ETA: 0s - loss: 2.6641 - accuracy: 0.2682
5/8 [=================>............] - ETA: 0s - loss: 2.6438 - accuracy: 0.2852
6/8 [=====================>........] - ETA: 0s - loss: 2.6239 - accuracy: 0.2998
7/8 [=========================>....] - ETA: 0s - loss: 2.6000 - accuracy: 0.3096
8/8 [==============================] - 1s 77ms/step - loss: 2.6118 - accuracy: 0.3140

8/8 [==============================] - 1s 100ms/step - loss: 2.6118 - accuracy: 0.3140 - val_loss: 2.5431 - val_accuracy: 0.3540
Epoch 33/100

1/8 [==>...........................] - ETA: 0s - loss: 2.5930 - accuracy: 0.3330
2/8 [======>.......................] - ETA: 0s - loss: 2.5489 - accuracy: 0.3435
3/8 [==========>...................] - ETA: 0s - loss: 2.5093 - accuracy: 0.3590
4/8 [==============>...............] - ETA: 0s - loss: 2.5481 - accuracy: 0.3550
5/8 [=================>............] - ETA: 0s - loss: 2.5625 - accuracy: 0.3260
6/8 [=====================>........] - ETA: 0s - loss: 2.5464 - accuracy: 0.3325
7/8 [=========================>....] - ETA: 0s - loss: 2.5593 - accuracy: 0.3340
8/8 [==============================] - 1s 79ms/step - loss: 2.5767 - accuracy: 0.3195

8/8 [==============================] - 1s 103ms/step - loss: 2.5767 - accuracy: 0.3195 - val_loss: 2.6095 - val_accuracy: 0.3540
Epoch 34/100

1/8 [==>...........................] - ETA: 0s - loss: 2.6288 - accuracy: 0.3400
2/8 [======>.......................] - ETA: 0s - loss: 2.6292 - accuracy: 0.3555
3/8 [==========>...................] - ETA: 0s - loss: 2.5696 - accuracy: 0.3550
4/8 [==============>...............] - ETA: 0s - loss: 2.6443 - accuracy: 0.3180
5/8 [=================>............] - ETA: 0s - loss: 2.6978 - accuracy: 0.3260
6/8 [=====================>........] - ETA: 0s - loss: 2.7269 - accuracy: 0.3317
7/8 [=========================>....] - ETA: 0s - loss: 2.7100 - accuracy: 0.3153
8/8 [==============================] - 1s 78ms/step - loss: 2.7160 - accuracy: 0.3192

8/8 [==============================] - 1s 101ms/step - loss: 2.7160 - accuracy: 0.3192 - val_loss: 2.7161 - val_accuracy: 0.3540
Epoch 35/100

1/8 [==>...........................] - ETA: 0s - loss: 2.7743 - accuracy: 0.3620
2/8 [======>.......................] - ETA: 0s - loss: 2.8255 - accuracy: 0.2845
3/8 [==========>...................] - ETA: 0s - loss: 2.8296 - accuracy: 0.2693
4/8 [==============>...............] - ETA: 0s - loss: 2.8307 - accuracy: 0.2948
5/8 [=================>............] - ETA: 0s - loss: 2.9019 - accuracy: 0.2766
6/8 [=====================>........] - ETA: 0s - loss: 2.8717 - accuracy: 0.2905
7/8 [=========================>....] - ETA: 0s - loss: 2.8526 - accuracy: 0.2967
8/8 [==============================] - 1s 78ms/step - loss: 2.8474 - accuracy: 0.3014

8/8 [==============================] - 1s 101ms/step - loss: 2.8474 - accuracy: 0.3014 - val_loss: 2.8885 - val_accuracy: 0.2220
Epoch 36/100

1/8 [==>...........................] - ETA: 0s - loss: 3.2486 - accuracy: 0.2350
2/8 [======>.......................] - ETA: 0s - loss: 3.2755 - accuracy: 0.2995
3/8 [==========>...................] - ETA: 0s - loss: 3.2872 - accuracy: 0.2173
4/8 [==============>...............] - ETA: 0s - loss: 3.2089 - accuracy: 0.2175
5/8 [=================>............] - ETA: 0s - loss: 3.1772 - accuracy: 0.2476
6/8 [=====================>........] - ETA: 0s - loss: 3.1267 - accuracy: 0.2620
7/8 [=========================>....] - ETA: 0s - loss: 3.1557 - accuracy: 0.2314
8/8 [==============================] - 1s 78ms/step - loss: 3.1309 - accuracy: 0.2280

8/8 [==============================] - 1s 101ms/step - loss: 3.1309 - accuracy: 0.2280 - val_loss: 4.0017 - val_accuracy: 0.3540
Epoch 37/100

1/8 [==>...........................] - ETA: 0s - loss: 3.8163 - accuracy: 0.3730
2/8 [======>.......................] - ETA: 0s - loss: 4.1070 - accuracy: 0.2155
3/8 [==========>...................] - ETA: 0s - loss: 4.3063 - accuracy: 0.2120
4/8 [==============>...............] - ETA: 0s - loss: 4.3994 - accuracy: 0.2470
5/8 [=================>............] - ETA: 0s - loss: 4.4074 - accuracy: 0.2684
6/8 [=====================>........] - ETA: 0s - loss: 4.4152 - accuracy: 0.2610
7/8 [=========================>....] - ETA: 0s - loss: 4.3944 - accuracy: 0.2756
8/8 [==============================] - 1s 78ms/step - loss: 4.3649 - accuracy: 0.2830

8/8 [==============================] - 1s 101ms/step - loss: 4.3649 - accuracy: 0.2830 - val_loss: 3.9180 - val_accuracy: 0.2220
Epoch 38/100

1/8 [==>...........................] - ETA: 0s - loss: 3.8415 - accuracy: 0.2170
2/8 [======>.......................] - ETA: 0s - loss: 3.9912 - accuracy: 0.2800
3/8 [==========>...................] - ETA: 0s - loss: 3.9488 - accuracy: 0.2033
4/8 [==============>...............] - ETA: 0s - loss: 3.8288 - accuracy: 0.2080
5/8 [=================>............] - ETA: 0s - loss: 3.7170 - accuracy: 0.2390
6/8 [=====================>........] - ETA: 0s - loss: 3.6701 - accuracy: 0.2047
7/8 [=========================>....] - ETA: 0s - loss: 3.6291 - accuracy: 0.2271
8/8 [==============================] - 1s 79ms/step - loss: 3.6129 - accuracy: 0.2403

8/8 [==============================] - 1s 102ms/step - loss: 3.6129 - accuracy: 0.2403 - val_loss: 3.3930 - val_accuracy: 0.2220
Epoch 39/100

1/8 [==>...........................] - ETA: 0s - loss: 3.4696 - accuracy: 0.2340
2/8 [======>.......................] - ETA: 0s - loss: 3.3214 - accuracy: 0.2905
3/8 [==========>...................] - ETA: 0s - loss: 3.2162 - accuracy: 0.3070
4/8 [==============>...............] - ETA: 0s - loss: 3.3504 - accuracy: 0.2430
5/8 [=================>............] - ETA: 0s - loss: 3.4418 - accuracy: 0.2366
6/8 [=====================>........] - ETA: 0s - loss: 3.6169 - accuracy: 0.2580
7/8 [=========================>....] - ETA: 0s - loss: 3.8127 - accuracy: 0.2709
8/8 [==============================] - 1s 77ms/step - loss: 3.9688 - accuracy: 0.2447

8/8 [==============================] - 1s 100ms/step - loss: 3.9688 - accuracy: 0.2447 - val_loss: 4.7984 - val_accuracy: 0.2220
Epoch 40/100

1/8 [==>...........................] - ETA: 0s - loss: 5.1260 - accuracy: 0.1820
2/8 [======>.......................] - ETA: 0s - loss: 5.3658 - accuracy: 0.2635
3/8 [==========>...................] - ETA: 0s - loss: 5.3856 - accuracy: 0.2453
4/8 [==============>...............] - ETA: 0s - loss: 5.2894 - accuracy: 0.2390
5/8 [=================>............] - ETA: 0s - loss: 5.2265 - accuracy: 0.2574
6/8 [=====================>........] - ETA: 0s - loss: 5.1467 - accuracy: 0.2697
7/8 [=========================>....] - ETA: 0s - loss: 4.9372 - accuracy: 0.2673
8/8 [==============================] - 1s 75ms/step - loss: 4.9260 - accuracy: 0.2399

8/8 [==============================] - 1s 98ms/step - loss: 4.9260 - accuracy: 0.2399 - val_loss: 4.7400 - val_accuracy: 0.3540
Epoch 41/100

1/8 [==>...........................] - ETA: 0s - loss: 5.3648 - accuracy: 0.3410
2/8 [======>.......................] - ETA: 0s - loss: 5.0001 - accuracy: 0.2915
3/8 [==========>...................] - ETA: 0s - loss: 4.8606 - accuracy: 0.2680
4/8 [==============>...............] - ETA: 0s - loss: 4.7060 - accuracy: 0.2925
5/8 [=================>............] - ETA: 0s - loss: 4.9428 - accuracy: 0.2440
6/8 [=====================>........] - ETA: 0s - loss: 5.0907 - accuracy: 0.2577
7/8 [=========================>....] - ETA: 0s - loss: 5.2654 - accuracy: 0.2519
8/8 [==============================] - 1s 74ms/step - loss: 5.2709 - accuracy: 0.2650

8/8 [==============================] - 1s 96ms/step - loss: 5.2709 - accuracy: 0.2650 - val_loss: 5.5478 - val_accuracy: 0.3540
Epoch 42/100

1/8 [==>...........................] - ETA: 0s - loss: 5.2812 - accuracy: 0.3580
2/8 [======>.......................] - ETA: 0s - loss: 5.3076 - accuracy: 0.3625
3/8 [==========>...................] - ETA: 0s - loss: 5.4289 - accuracy: 0.3480
4/8 [==============>...............] - ETA: 0s - loss: 5.5214 - accuracy: 0.3140
5/8 [=================>............] - ETA: 0s - loss: 5.8176 - accuracy: 0.2590
6/8 [=====================>........] - ETA: 0s - loss: 6.3116 - accuracy: 0.2728
7/8 [=========================>....] - ETA: 0s - loss: 6.5533 - accuracy: 0.2816
8/8 [==============================] - 1s 73ms/step - loss: 6.7478 - accuracy: 0.2529

8/8 [==============================] - 1s 96ms/step - loss: 6.7478 - accuracy: 0.2529 - val_loss: 10.2458 - val_accuracy: 0.2220
Epoch 43/100

1/8 [==>...........................] - ETA: 0s - loss: 10.4858 - accuracy: 0.2200
2/8 [======>.......................] - ETA: 0s - loss: 9.8757 - accuracy: 0.1145 
3/8 [==========>...................] - ETA: 0s - loss: 9.4796 - accuracy: 0.1940
4/8 [==============>...............] - ETA: 0s - loss: 9.2560 - accuracy: 0.2393
5/8 [=================>............] - ETA: 0s - loss: 9.1474 - accuracy: 0.1954
6/8 [=====================>........] - ETA: 0s - loss: 9.2790 - accuracy: 0.1932
7/8 [=========================>....] - ETA: 0s - loss: 9.7562 - accuracy: 0.1729
8/8 [==============================] - 1s 71ms/step - loss: 9.8543 - accuracy: 0.1962

8/8 [==============================] - 1s 94ms/step - loss: 9.8543 - accuracy: 0.1962 - val_loss: 11.1315 - val_accuracy: 0.3540
Epoch 44/100

1/8 [==>...........................] - ETA: 0s - loss: 10.1667 - accuracy: 0.3530
2/8 [======>.......................] - ETA: 0s - loss: 11.2466 - accuracy: 0.2855
3/8 [==========>...................] - ETA: 0s - loss: 11.2096 - accuracy: 0.2017
4/8 [==============>...............] - ETA: 0s - loss: 11.2505 - accuracy: 0.1532
5/8 [=================>............] - ETA: 0s - loss: 11.3662 - accuracy: 0.1954
6/8 [=====================>........] - ETA: 0s - loss: 11.2554 - accuracy: 0.2230
7/8 [=========================>....] - ETA: 0s - loss: 11.5053 - accuracy: 0.2009
8/8 [==============================] - 1s 70ms/step - loss: 11.9265 - accuracy: 0.2030

8/8 [==============================] - 1s 92ms/step - loss: 11.9265 - accuracy: 0.2030 - val_loss: 11.9275 - val_accuracy: 0.0010
Epoch 45/100

1/8 [==>...........................] - ETA: 0s - loss: 12.1189 - accuracy: 0.0050
2/8 [======>.......................] - ETA: 0s - loss: 12.7856 - accuracy: 0.1805
3/8 [==========>...................] - ETA: 0s - loss: 12.7177 - accuracy: 0.1370
4/8 [==============>...............] - ETA: 0s - loss: 13.2837 - accuracy: 0.1150
5/8 [=================>............] - ETA: 0s - loss: 13.1557 - accuracy: 0.1590
6/8 [=====================>........] - ETA: 0s - loss: 13.4004 - accuracy: 0.1723
7/8 [=========================>....] - ETA: 0s - loss: 13.3275 - accuracy: 0.1961
8/8 [==============================] - 1s 70ms/step - loss: 13.2617 - accuracy: 0.1740

8/8 [==============================] - 1s 92ms/step - loss: 13.2617 - accuracy: 0.1740 - val_loss: 13.1351 - val_accuracy: 0.3540
Epoch 46/100

1/8 [==>...........................] - ETA: 0s - loss: 13.1861 - accuracy: 0.3440
2/8 [======>.......................] - ETA: 0s - loss: 13.3482 - accuracy: 0.1925
3/8 [==========>...................] - ETA: 0s - loss: 13.7078 - accuracy: 0.1977
4/8 [==============>...............] - ETA: 0s - loss: 13.4502 - accuracy: 0.2432
5/8 [=================>............] - ETA: 0s - loss: 13.3298 - accuracy: 0.2046
6/8 [=====================>........] - ETA: 0s - loss: 13.3755 - accuracy: 0.1797
7/8 [=========================>....] - ETA: 0s - loss: 13.3008 - accuracy: 0.1547
8/8 [==============================] - 1s 70ms/step - loss: 13.6033 - accuracy: 0.1429

8/8 [==============================] - 1s 92ms/step - loss: 13.6033 - accuracy: 0.1429 - val_loss: 15.2691 - val_accuracy: 0.0250
Epoch 47/100

1/8 [==>...........................] - ETA: 0s - loss: 15.3934 - accuracy: 0.0300
2/8 [======>.......................] - ETA: 0s - loss: 16.3438 - accuracy: 0.1810
3/8 [==========>...................] - ETA: 0s - loss: 16.6229 - accuracy: 0.1917
4/8 [==============>...............] - ETA: 0s - loss: 17.2869 - accuracy: 0.2335
5/8 [=================>............] - ETA: 0s - loss: 17.4266 - accuracy: 0.2564
6/8 [=====================>........] - ETA: 0s - loss: 17.3660 - accuracy: 0.2527
7/8 [=========================>....] - ETA: 0s - loss: 17.3895 - accuracy: 0.2177
8/8 [==============================] - 1s 69ms/step - loss: 17.1159 - accuracy: 0.2354

8/8 [==============================] - 1s 91ms/step - loss: 17.1159 - accuracy: 0.2354 - val_loss: 16.1810 - val_accuracy: 0.0460
Epoch 48/100

1/8 [==>...........................] - ETA: 0s - loss: 15.1339 - accuracy: 0.0560
2/8 [======>.......................] - ETA: 0s - loss: 13.8744 - accuracy: 0.0340
3/8 [==========>...................] - ETA: 0s - loss: 14.3866 - accuracy: 0.1397
4/8 [==============>...............] - ETA: 0s - loss: 14.8065 - accuracy: 0.1168
5/8 [=================>............] - ETA: 0s - loss: 15.2380 - accuracy: 0.1628
6/8 [=====================>........] - ETA: 0s - loss: 15.7328 - accuracy: 0.1445
7/8 [=========================>....] - ETA: 0s - loss: 16.2884 - accuracy: 0.1559
8/8 [==============================] - 1s 69ms/step - loss: 16.6205 - accuracy: 0.1795

8/8 [==============================] - 1s 91ms/step - loss: 16.6205 - accuracy: 0.1795 - val_loss: 18.4511 - val_accuracy: 0.3540
Epoch 49/100

1/8 [==>...........................] - ETA: 0s - loss: 17.2821 - accuracy: 0.3720
2/8 [======>.......................] - ETA: 0s - loss: 16.6298 - accuracy: 0.2155
3/8 [==========>...................] - ETA: 0s - loss: 17.4144 - accuracy: 0.2173
4/8 [==============>...............] - ETA: 0s - loss: 16.9927 - accuracy: 0.1678
5/8 [=================>............] - ETA: 0s - loss: 16.7762 - accuracy: 0.2046
6/8 [=====================>........] - ETA: 0s - loss: 16.7489 - accuracy: 0.2278
7/8 [=========================>....] - ETA: 0s - loss: 16.6180 - accuracy: 0.2224
8/8 [==============================] - 1s 71ms/step - loss: 16.4897 - accuracy: 0.1969

8/8 [==============================] - 1s 94ms/step - loss: 16.4897 - accuracy: 0.1969 - val_loss: 14.8279 - val_accuracy: 0.0470
Epoch 50/100

1/8 [==>...........................] - ETA: 0s - loss: 13.5293 - accuracy: 0.0470
2/8 [======>.......................] - ETA: 0s - loss: 13.7848 - accuracy: 0.2090
3/8 [==========>...................] - ETA: 0s - loss: 13.7660 - accuracy: 0.2557
4/8 [==============>...............] - ETA: 0s - loss: 13.4581 - accuracy: 0.2503
5/8 [=================>............] - ETA: 0s - loss: 13.7005 - accuracy: 0.2104
6/8 [=====================>........] - ETA: 0s - loss: 14.0642 - accuracy: 0.2355
7/8 [=========================>....] - ETA: 0s - loss: 14.4481 - accuracy: 0.2529
8/8 [==============================] - 1s 72ms/step - loss: 14.8130 - accuracy: 0.2278

8/8 [==============================] - 1s 95ms/step - loss: 14.8130 - accuracy: 0.2278 - val_loss: 18.0657 - val_accuracy: 0.0030
Epoch 51/100

1/8 [==>...........................] - ETA: 0s - loss: 16.7917 - accuracy: 0.0070
2/8 [======>.......................] - ETA: 0s - loss: 17.3744 - accuracy: 0.1110
3/8 [==========>...................] - ETA: 0s - loss: 18.4762 - accuracy: 0.1833
4/8 [==============>...............] - ETA: 0s - loss: 18.5310 - accuracy: 0.1558
5/8 [=================>............] - ETA: 0s - loss: 18.6609 - accuracy: 0.1970
6/8 [=====================>........] - ETA: 0s - loss: 19.1596 - accuracy: 0.2030
7/8 [=========================>....] - ETA: 0s - loss: 19.1078 - accuracy: 0.2063
8/8 [==============================] - 1s 70ms/step - loss: 19.1359 - accuracy: 0.1875

8/8 [==============================] - 1s 91ms/step - loss: 19.1359 - accuracy: 0.1875 - val_loss: 22.0712 - val_accuracy: 0.3540
Epoch 52/100

1/8 [==>...........................] - ETA: 0s - loss: 23.8323 - accuracy: 0.3400
2/8 [======>.......................] - ETA: 0s - loss: 23.0005 - accuracy: 0.3400
3/8 [==========>...................] - ETA: 0s - loss: 21.7232 - accuracy: 0.2383
4/8 [==============>...............] - ETA: 0s - loss: 21.2656 - accuracy: 0.2307
5/8 [=================>............] - ETA: 0s - loss: 20.2475 - accuracy: 0.2276
6/8 [=====================>........] - ETA: 0s - loss: 19.8263 - accuracy: 0.2505
7/8 [=========================>....] - ETA: 0s - loss: 19.3890 - accuracy: 0.2686
8/8 [==============================] - 1s 71ms/step - loss: 18.7630 - accuracy: 0.2380

8/8 [==============================] - 1s 93ms/step - loss: 18.7630 - accuracy: 0.2380 - val_loss: 18.5380 - val_accuracy: 0.0460
Epoch 53/100

1/8 [==>...........................] - ETA: 0s - loss: 19.0295 - accuracy: 0.0440
2/8 [======>.......................] - ETA: 0s - loss: 17.7680 - accuracy: 0.1290
3/8 [==========>...................] - ETA: 0s - loss: 18.0180 - accuracy: 0.1547
4/8 [==============>...............] - ETA: 0s - loss: 17.7008 - accuracy: 0.1308
5/8 [=================>............] - ETA: 0s - loss: 17.9300 - accuracy: 0.1740
6/8 [=====================>........] - ETA: 0s - loss: 17.8219 - accuracy: 0.2030
7/8 [=========================>....] - ETA: 0s - loss: 17.3889 - accuracy: 0.2059
8/8 [==============================] - 1s 71ms/step - loss: 17.4303 - accuracy: 0.1858

8/8 [==============================] - 1s 93ms/step - loss: 17.4303 - accuracy: 0.1858 - val_loss: 17.1311 - val_accuracy: 0.2220
Epoch 54/100

1/8 [==>...........................] - ETA: 0s - loss: 16.9750 - accuracy: 0.2220
2/8 [======>.......................] - ETA: 0s - loss: 15.2875 - accuracy: 0.2130
3/8 [==========>...................] - ETA: 0s - loss: 15.9525 - accuracy: 0.2577
4/8 [==============>...............] - ETA: 0s - loss: 16.2467 - accuracy: 0.2058
5/8 [=================>............] - ETA: 0s - loss: 16.4299 - accuracy: 0.1660
6/8 [=====================>........] - ETA: 0s - loss: 16.3835 - accuracy: 0.1465
7/8 [=========================>....] - ETA: 0s - loss: 16.1362 - accuracy: 0.1747
8/8 [==============================] - 1s 76ms/step - loss: 15.9992 - accuracy: 0.1540

8/8 [==============================] - 1s 98ms/step - loss: 15.9992 - accuracy: 0.1540 - val_loss: 14.7804 - val_accuracy: 0.2220
Epoch 55/100

1/8 [==>...........................] - ETA: 0s - loss: 16.7508 - accuracy: 0.2290
2/8 [======>.......................] - ETA: 0s - loss: 15.6435 - accuracy: 0.1205
3/8 [==========>...................] - ETA: 0s - loss: 16.0468 - accuracy: 0.1860
4/8 [==============>...............] - ETA: 0s - loss: 15.8468 - accuracy: 0.1523
5/8 [=================>............] - ETA: 0s - loss: 15.4357 - accuracy: 0.1930
6/8 [=====================>........] - ETA: 0s - loss: 15.4231 - accuracy: 0.1980
7/8 [=========================>....] - ETA: 0s - loss: 15.3093 - accuracy: 0.1799
8/8 [==============================] - 1s 71ms/step - loss: 15.0569 - accuracy: 0.2051

8/8 [==============================] - 1s 94ms/step - loss: 15.0569 - accuracy: 0.2051 - val_loss: 13.4248 - val_accuracy: 0.3540
Epoch 56/100

1/8 [==>...........................] - ETA: 0s - loss: 15.0031 - accuracy: 0.3330
2/8 [======>.......................] - ETA: 0s - loss: 14.3500 - accuracy: 0.2745
3/8 [==========>...................] - ETA: 0s - loss: 14.1706 - accuracy: 0.1913
4/8 [==============>...............] - ETA: 0s - loss: 14.3506 - accuracy: 0.2235
5/8 [=================>............] - ETA: 0s - loss: 14.1291 - accuracy: 0.1868
6/8 [=====================>........] - ETA: 0s - loss: 14.4635 - accuracy: 0.1623
7/8 [=========================>....] - ETA: 0s - loss: 14.5340 - accuracy: 0.1903
8/8 [==============================] - 1s 71ms/step - loss: 14.5975 - accuracy: 0.1745

8/8 [==============================] - 1s 94ms/step - loss: 14.5975 - accuracy: 0.1745 - val_loss: 14.1575 - val_accuracy: 0.2220
Epoch 57/100

1/8 [==>...........................] - ETA: 0s - loss: 15.1006 - accuracy: 0.2080
2/8 [======>.......................] - ETA: 0s - loss: 14.4015 - accuracy: 0.2150
3/8 [==========>...................] - ETA: 0s - loss: 14.9121 - accuracy: 0.2610
4/8 [==============>...............] - ETA: 0s - loss: 15.0863 - accuracy: 0.2858
5/8 [=================>............] - ETA: 0s - loss: 14.9663 - accuracy: 0.2330
6/8 [=====================>........] - ETA: 0s - loss: 14.8378 - accuracy: 0.2027
7/8 [=========================>....] - ETA: 0s - loss: 15.0651 - accuracy: 0.2037
8/8 [==============================] - 1s 72ms/step - loss: 14.9100 - accuracy: 0.2047

8/8 [==============================] - 1s 95ms/step - loss: 14.9100 - accuracy: 0.2047 - val_loss: 14.0608 - val_accuracy: 0.3540
Epoch 58/100

1/8 [==>...........................] - ETA: 0s - loss: 14.9696 - accuracy: 0.3400
2/8 [======>.......................] - ETA: 0s - loss: 15.5900 - accuracy: 0.1730
3/8 [==========>...................] - ETA: 0s - loss: 14.7928 - accuracy: 0.1397
4/8 [==============>...............] - ETA: 0s - loss: 14.3965 - accuracy: 0.1612
5/8 [=================>............] - ETA: 0s - loss: 14.1258 - accuracy: 0.2000
6/8 [=====================>........] - ETA: 0s - loss: 14.2081 - accuracy: 0.1708
7/8 [=========================>....] - ETA: 0s - loss: 14.0224 - accuracy: 0.1994
8/8 [==============================] - 1s 73ms/step - loss: 14.8041 - accuracy: 0.1808

8/8 [==============================] - 1s 96ms/step - loss: 14.8041 - accuracy: 0.1808 - val_loss: 15.9696 - val_accuracy: 0.2220
Epoch 59/100

1/8 [==>...........................] - ETA: 0s - loss: 16.2039 - accuracy: 0.2030
2/8 [======>.......................] - ETA: 0s - loss: 17.2583 - accuracy: 0.2755
3/8 [==========>...................] - ETA: 0s - loss: 17.6071 - accuracy: 0.3000
4/8 [==============>...............] - ETA: 0s - loss: 17.5786 - accuracy: 0.2350
5/8 [=================>............] - ETA: 0s - loss: 17.0094 - accuracy: 0.2574
6/8 [=====================>........] - ETA: 0s - loss: 16.7280 - accuracy: 0.2538
7/8 [=========================>....] - ETA: 0s - loss: 16.4449 - accuracy: 0.2644
8/8 [==============================] - 1s 73ms/step - loss: 16.4410 - accuracy: 0.2389

8/8 [==============================] - 1s 96ms/step - loss: 16.4410 - accuracy: 0.2389 - val_loss: 13.5859 - val_accuracy: 0.0080
Epoch 60/100

1/8 [==>...........................] - ETA: 0s - loss: 14.3658 - accuracy: 0.0070
2/8 [======>.......................] - ETA: 0s - loss: 14.0201 - accuracy: 0.1715
3/8 [==========>...................] - ETA: 0s - loss: 14.4714 - accuracy: 0.1313
4/8 [==============>...............] - ETA: 0s - loss: 14.5006 - accuracy: 0.1535
5/8 [=================>............] - ETA: 0s - loss: 14.7860 - accuracy: 0.1262
6/8 [=====================>........] - ETA: 0s - loss: 14.6803 - accuracy: 0.1643
7/8 [=========================>....] - ETA: 0s - loss: 14.9635 - accuracy: 0.1901
8/8 [==============================] - 1s 74ms/step - loss: 15.0521 - accuracy: 0.1673

8/8 [==============================] - 1s 96ms/step - loss: 15.0521 - accuracy: 0.1673 - val_loss: 13.0609 - val_accuracy: 0.0470
Epoch 61/100

1/8 [==>...........................] - ETA: 0s - loss: 14.9008 - accuracy: 0.0470
2/8 [======>.......................] - ETA: 0s - loss: 15.2776 - accuracy: 0.1330
3/8 [==========>...................] - ETA: 0s - loss: 14.3698 - accuracy: 0.2190
4/8 [==============>...............] - ETA: 0s - loss: 14.3219 - accuracy: 0.2525
5/8 [=================>............] - ETA: 0s - loss: 14.1922 - accuracy: 0.2042
6/8 [=====================>........] - ETA: 0s - loss: 14.1486 - accuracy: 0.1787
7/8 [=========================>....] - ETA: 0s - loss: 13.9729 - accuracy: 0.1831
8/8 [==============================] - 1s 73ms/step - loss: 13.8728 - accuracy: 0.2045

8/8 [==============================] - 1s 96ms/step - loss: 13.8728 - accuracy: 0.2045 - val_loss: 14.0447 - val_accuracy: 0.3540
Epoch 62/100

1/8 [==>...........................] - ETA: 0s - loss: 13.9814 - accuracy: 0.3520
2/8 [======>.......................] - ETA: 0s - loss: 14.4210 - accuracy: 0.1820
3/8 [==========>...................] - ETA: 0s - loss: 13.8979 - accuracy: 0.2387
4/8 [==============>...............] - ETA: 0s - loss: 13.2797 - accuracy: 0.2673
5/8 [=================>............] - ETA: 0s - loss: 13.3600 - accuracy: 0.2570
6/8 [=====================>........] - ETA: 0s - loss: 14.0393 - accuracy: 0.2232
7/8 [=========================>....] - ETA: 0s - loss: 14.0623 - accuracy: 0.2196
8/8 [==============================] - 1s 74ms/step - loss: 14.1708 - accuracy: 0.2352

8/8 [==============================] - 1s 96ms/step - loss: 14.1708 - accuracy: 0.2352 - val_loss: 14.4635 - val_accuracy: 0.3540
Epoch 63/100

1/8 [==>...........................] - ETA: 0s - loss: 15.3378 - accuracy: 0.3470
2/8 [======>.......................] - ETA: 0s - loss: 14.6810 - accuracy: 0.1965
3/8 [==========>...................] - ETA: 0s - loss: 13.7229 - accuracy: 0.1993
4/8 [==============>...............] - ETA: 0s - loss: 13.7875 - accuracy: 0.1640
5/8 [=================>............] - ETA: 0s - loss: 14.0654 - accuracy: 0.1980
6/8 [=====================>........] - ETA: 0s - loss: 14.2911 - accuracy: 0.1727
7/8 [=========================>....] - ETA: 0s - loss: 14.3633 - accuracy: 0.1806
8/8 [==============================] - 1s 74ms/step - loss: 14.1472 - accuracy: 0.1829

8/8 [==============================] - 1s 97ms/step - loss: 14.1472 - accuracy: 0.1829 - val_loss: 14.3057 - val_accuracy: 0.3540
Epoch 64/100

1/8 [==>...........................] - ETA: 0s - loss: 12.7756 - accuracy: 0.3690
2/8 [======>.......................] - ETA: 0s - loss: 12.8337 - accuracy: 0.2120
3/8 [==========>...................] - ETA: 0s - loss: 12.7969 - accuracy: 0.2537
4/8 [==============>...............] - ETA: 0s - loss: 12.6925 - accuracy: 0.2745
5/8 [=================>............] - ETA: 0s - loss: 12.7327 - accuracy: 0.2622
6/8 [=====================>........] - ETA: 0s - loss: 12.5270 - accuracy: 0.2232
7/8 [=========================>....] - ETA: 0s - loss: 12.4170 - accuracy: 0.2433
8/8 [==============================] - 1s 75ms/step - loss: 12.1599 - accuracy: 0.2156

8/8 [==============================] - 1s 97ms/step - loss: 12.1599 - accuracy: 0.2156 - val_loss: 11.6307 - val_accuracy: 0.0590
Epoch 65/100

1/8 [==>...........................] - ETA: 0s - loss: 12.1241 - accuracy: 0.0600
2/8 [======>.......................] - ETA: 0s - loss: 11.6050 - accuracy: 0.1405
3/8 [==========>...................] - ETA: 0s - loss: 12.2885 - accuracy: 0.2100
4/8 [==============>...............] - ETA: 0s - loss: 12.3981 - accuracy: 0.2442
5/8 [=================>............] - ETA: 0s - loss: 12.1858 - accuracy: 0.2636
6/8 [=====================>........] - ETA: 0s - loss: 12.2425 - accuracy: 0.2540
7/8 [=========================>....] - ETA: 0s - loss: 12.3253 - accuracy: 0.2476
8/8 [==============================] - 1s 71ms/step - loss: 12.2668 - accuracy: 0.2598

8/8 [==============================] - 1s 94ms/step - loss: 12.2668 - accuracy: 0.2598 - val_loss: 11.3727 - val_accuracy: 0.3540
Epoch 66/100

1/8 [==>...........................] - ETA: 0s - loss: 11.2852 - accuracy: 0.3780
2/8 [======>.......................] - ETA: 0s - loss: 11.6100 - accuracy: 0.3515
3/8 [==========>...................] - ETA: 0s - loss: 10.9735 - accuracy: 0.2353
4/8 [==============>...............] - ETA: 0s - loss: 10.8240 - accuracy: 0.2253
5/8 [=================>............] - ETA: 0s - loss: 10.8777 - accuracy: 0.1926
6/8 [=====================>........] - ETA: 0s - loss: 10.5270 - accuracy: 0.2147
7/8 [=========================>....] - ETA: 0s - loss: 10.4284 - accuracy: 0.2333
8/8 [==============================] - 1s 70ms/step - loss: 10.2623 - accuracy: 0.2056

8/8 [==============================] - 1s 93ms/step - loss: 10.2623 - accuracy: 0.2056 - val_loss: 9.2829 - val_accuracy: 0.2220
Epoch 67/100

1/8 [==>...........................] - ETA: 0s - loss: 9.1642 - accuracy: 0.2170
2/8 [======>.......................] - ETA: 0s - loss: 8.6517 - accuracy: 0.2865
3/8 [==========>...................] - ETA: 0s - loss: 9.0689 - accuracy: 0.2000
4/8 [==============>...............] - ETA: 0s - loss: 9.2397 - accuracy: 0.2377
5/8 [=================>............] - ETA: 0s - loss: 9.4466 - accuracy: 0.1922
6/8 [=====================>........] - ETA: 0s - loss: 9.4628 - accuracy: 0.1953
7/8 [=========================>....] - ETA: 0s - loss: 9.3833 - accuracy: 0.1990
8/8 [==============================] - 1s 70ms/step - loss: 9.2447 - accuracy: 0.2185

8/8 [==============================] - 1s 91ms/step - loss: 9.2447 - accuracy: 0.2185 - val_loss: 7.9668 - val_accuracy: 0.3540
Epoch 68/100

1/8 [==>...........................] - ETA: 0s - loss: 7.5064 - accuracy: 0.3590
2/8 [======>.......................] - ETA: 0s - loss: 9.3256 - accuracy: 0.2120
3/8 [==========>...................] - ETA: 0s - loss: 9.4124 - accuracy: 0.2037
4/8 [==============>...............] - ETA: 0s - loss: 9.6157 - accuracy: 0.2395
5/8 [=================>............] - ETA: 0s - loss: 9.7032 - accuracy: 0.2566
6/8 [=====================>........] - ETA: 0s - loss: 9.7349 - accuracy: 0.2208
7/8 [=========================>....] - ETA: 0s - loss: 9.6753 - accuracy: 0.1924
8/8 [==============================] - 1s 69ms/step - loss: 9.5266 - accuracy: 0.1948

8/8 [==============================] - 1s 91ms/step - loss: 9.5266 - accuracy: 0.1948 - val_loss: 9.9428 - val_accuracy: 0.3540
Epoch 69/100

1/8 [==>...........................] - ETA: 0s - loss: 11.5860 - accuracy: 0.3520
2/8 [======>.......................] - ETA: 0s - loss: 10.7716 - accuracy: 0.3570
3/8 [==========>...................] - ETA: 0s - loss: 10.5814 - accuracy: 0.3563
4/8 [==============>...............] - ETA: 0s - loss: 10.4899 - accuracy: 0.3178
5/8 [=================>............] - ETA: 0s - loss: 10.1263 - accuracy: 0.3220
6/8 [=====================>........] - ETA: 0s - loss: 9.8561 - accuracy: 0.3262 
7/8 [=========================>....] - ETA: 0s - loss: 9.7760 - accuracy: 0.2801
8/8 [==============================] - 1s 72ms/step - loss: 9.6828 - accuracy: 0.2536

8/8 [==============================] - 1s 94ms/step - loss: 9.6828 - accuracy: 0.2536 - val_loss: 7.9908 - val_accuracy: 0.2220
Epoch 70/100

1/8 [==>...........................] - ETA: 0s - loss: 7.7298 - accuracy: 0.2270
2/8 [======>.......................] - ETA: 0s - loss: 7.6442 - accuracy: 0.2915
3/8 [==========>...................] - ETA: 0s - loss: 7.7095 - accuracy: 0.3083
4/8 [==============>...............] - ETA: 0s - loss: 8.0691 - accuracy: 0.2412
5/8 [=================>............] - ETA: 0s - loss: 8.3765 - accuracy: 0.2350
6/8 [=====================>........] - ETA: 0s - loss: 8.1899 - accuracy: 0.2537
7/8 [=========================>....] - ETA: 0s - loss: 8.2205 - accuracy: 0.2664
8/8 [==============================] - 1s 68ms/step - loss: 8.2784 - accuracy: 0.2417

8/8 [==============================] - 1s 91ms/step - loss: 8.2784 - accuracy: 0.2417 - val_loss: 7.4371 - val_accuracy: 0.2220
Epoch 71/100

1/8 [==>...........................] - ETA: 0s - loss: 8.1744 - accuracy: 0.2160
2/8 [======>.......................] - ETA: 0s - loss: 7.9651 - accuracy: 0.2875
3/8 [==========>...................] - ETA: 0s - loss: 8.1550 - accuracy: 0.3057
4/8 [==============>...............] - ETA: 0s - loss: 8.0937 - accuracy: 0.2875
5/8 [=================>............] - ETA: 0s - loss: 7.7919 - accuracy: 0.2708
6/8 [=====================>........] - ETA: 0s - loss: 7.8388 - accuracy: 0.2260
7/8 [=========================>....] - ETA: 0s - loss: 7.7576 - accuracy: 0.2456
8/8 [==============================] - 1s 70ms/step - loss: 7.7109 - accuracy: 0.2587

8/8 [==============================] - 1s 92ms/step - loss: 7.7109 - accuracy: 0.2587 - val_loss: 6.6829 - val_accuracy: 0.0590
Epoch 72/100

1/8 [==>...........................] - ETA: 0s - loss: 7.8888 - accuracy: 0.0620
2/8 [======>.......................] - ETA: 0s - loss: 8.0956 - accuracy: 0.1355
3/8 [==========>...................] - ETA: 0s - loss: 7.1620 - accuracy: 0.2073
4/8 [==============>...............] - ETA: 0s - loss: 7.2430 - accuracy: 0.2457
5/8 [=================>............] - ETA: 0s - loss: 7.5031 - accuracy: 0.2034
6/8 [=====================>........] - ETA: 0s - loss: 7.5542 - accuracy: 0.2297
7/8 [=========================>....] - ETA: 0s - loss: 7.5749 - accuracy: 0.2277
8/8 [==============================] - 1s 69ms/step - loss: 7.7344 - accuracy: 0.2437

8/8 [==============================] - 1s 91ms/step - loss: 7.7344 - accuracy: 0.2437 - val_loss: 7.3931 - val_accuracy: 0.3540
Epoch 73/100

1/8 [==>...........................] - ETA: 0s - loss: 7.7066 - accuracy: 0.3580
2/8 [======>.......................] - ETA: 0s - loss: 7.9583 - accuracy: 0.2035
3/8 [==========>...................] - ETA: 0s - loss: 7.5334 - accuracy: 0.2087
4/8 [==============>...............] - ETA: 0s - loss: 7.5365 - accuracy: 0.2477
5/8 [=================>............] - ETA: 0s - loss: 7.5290 - accuracy: 0.2712
6/8 [=====================>........] - ETA: 0s - loss: 7.6459 - accuracy: 0.2363
7/8 [=========================>....] - ETA: 0s - loss: 7.6807 - accuracy: 0.2333
8/8 [==============================] - 1s 70ms/step - loss: 7.8120 - accuracy: 0.2481

8/8 [==============================] - 1s 92ms/step - loss: 7.8120 - accuracy: 0.2481 - val_loss: 7.1363 - val_accuracy: 0.3540
Epoch 74/100

1/8 [==>...........................] - ETA: 0s - loss: 8.2139 - accuracy: 0.3340
2/8 [======>.......................] - ETA: 0s - loss: 8.8608 - accuracy: 0.1875
3/8 [==========>...................] - ETA: 0s - loss: 8.1402 - accuracy: 0.2007
4/8 [==============>...............] - ETA: 0s - loss: 7.9755 - accuracy: 0.2333
5/8 [=================>............] - ETA: 0s - loss: 7.7487 - accuracy: 0.2290
6/8 [=====================>........] - ETA: 0s - loss: 7.5294 - accuracy: 0.2248
7/8 [=========================>....] - ETA: 0s - loss: 7.3576 - accuracy: 0.2439
8/8 [==============================] - 1s 71ms/step - loss: 7.2066 - accuracy: 0.2200

8/8 [==============================] - 1s 93ms/step - loss: 7.2066 - accuracy: 0.2200 - val_loss: 5.7187 - val_accuracy: 0.3540
Epoch 75/100

1/8 [==>...........................] - ETA: 0s - loss: 6.4873 - accuracy: 0.3710
2/8 [======>.......................] - ETA: 0s - loss: 6.2771 - accuracy: 0.2925
3/8 [==========>...................] - ETA: 0s - loss: 6.2919 - accuracy: 0.2113
4/8 [==============>...............] - ETA: 0s - loss: 6.7190 - accuracy: 0.2415
5/8 [=================>............] - ETA: 0s - loss: 6.7509 - accuracy: 0.2046
6/8 [=====================>........] - ETA: 0s - loss: 6.7229 - accuracy: 0.2068
7/8 [=========================>....] - ETA: 0s - loss: 6.8149 - accuracy: 0.2279
8/8 [==============================] - 1s 71ms/step - loss: 6.9329 - accuracy: 0.2425

8/8 [==============================] - 1s 94ms/step - loss: 6.9329 - accuracy: 0.2425 - val_loss: 7.2681 - val_accuracy: 0.2220
Epoch 76/100

1/8 [==>...........................] - ETA: 0s - loss: 8.0910 - accuracy: 0.2250
2/8 [======>.......................] - ETA: 0s - loss: 7.8244 - accuracy: 0.2920
3/8 [==========>...................] - ETA: 0s - loss: 7.4679 - accuracy: 0.3160
4/8 [==============>...............] - ETA: 0s - loss: 7.3035 - accuracy: 0.3232
5/8 [=================>............] - ETA: 0s - loss: 7.2500 - accuracy: 0.3294
6/8 [=====================>........] - ETA: 0s - loss: 6.9765 - accuracy: 0.3308
7/8 [=========================>....] - ETA: 0s - loss: 6.7903 - accuracy: 0.2911
8/8 [==============================] - 1s 72ms/step - loss: 6.6049 - accuracy: 0.2796

8/8 [==============================] - 1s 94ms/step - loss: 6.6049 - accuracy: 0.2796 - val_loss: 4.6555 - val_accuracy: 0.3540
Epoch 77/100

1/8 [==>...........................] - ETA: 0s - loss: 5.7704 - accuracy: 0.3310
2/8 [======>.......................] - ETA: 0s - loss: 4.8188 - accuracy: 0.3465
3/8 [==========>...................] - ETA: 0s - loss: 4.6501 - accuracy: 0.2947
4/8 [==============>...............] - ETA: 0s - loss: 5.0250 - accuracy: 0.2368
5/8 [=================>............] - ETA: 0s - loss: 5.0792 - accuracy: 0.2572
6/8 [=====================>........] - ETA: 0s - loss: 5.2229 - accuracy: 0.2527
7/8 [=========================>....] - ETA: 0s - loss: 5.2466 - accuracy: 0.2664
8/8 [==============================] - 1s 73ms/step - loss: 5.2972 - accuracy: 0.2776

8/8 [==============================] - 1s 96ms/step - loss: 5.2972 - accuracy: 0.2776 - val_loss: 5.0129 - val_accuracy: 0.3540
Epoch 78/100

1/8 [==>...........................] - ETA: 0s - loss: 5.2370 - accuracy: 0.3510
2/8 [======>.......................] - ETA: 0s - loss: 5.2827 - accuracy: 0.2040
3/8 [==========>...................] - ETA: 0s - loss: 5.4027 - accuracy: 0.2123
4/8 [==============>...............] - ETA: 0s - loss: 5.3499 - accuracy: 0.2450
5/8 [=================>............] - ETA: 0s - loss: 5.2601 - accuracy: 0.2052
6/8 [=====================>........] - ETA: 0s - loss: 5.1273 - accuracy: 0.1763
7/8 [=========================>....] - ETA: 0s - loss: 5.0022 - accuracy: 0.1813
8/8 [==============================] - 1s 74ms/step - loss: 4.8889 - accuracy: 0.2026

8/8 [==============================] - 1s 96ms/step - loss: 4.8889 - accuracy: 0.2026 - val_loss: 3.7221 - val_accuracy: 0.3540
Epoch 79/100

1/8 [==>...........................] - ETA: 0s - loss: 3.6656 - accuracy: 0.3500
2/8 [======>.......................] - ETA: 0s - loss: 4.0157 - accuracy: 0.2060
3/8 [==========>...................] - ETA: 0s - loss: 4.1751 - accuracy: 0.2480
4/8 [==============>...............] - ETA: 0s - loss: 4.1407 - accuracy: 0.2765
5/8 [=================>............] - ETA: 0s - loss: 4.1987 - accuracy: 0.2924
6/8 [=====================>........] - ETA: 0s - loss: 4.2279 - accuracy: 0.3025
7/8 [=========================>....] - ETA: 0s - loss: 4.2574 - accuracy: 0.3077
8/8 [==============================] - 1s 74ms/step - loss: 4.2753 - accuracy: 0.3138

8/8 [==============================] - 1s 96ms/step - loss: 4.2753 - accuracy: 0.3138 - val_loss: 4.1240 - val_accuracy: 0.2220
Epoch 80/100

1/8 [==>...........................] - ETA: 0s - loss: 4.1007 - accuracy: 0.2270
2/8 [======>.......................] - ETA: 0s - loss: 3.6643 - accuracy: 0.2910
3/8 [==========>...................] - ETA: 0s - loss: 3.6783 - accuracy: 0.2093
4/8 [==============>...............] - ETA: 0s - loss: 3.7160 - accuracy: 0.2447
5/8 [=================>............] - ETA: 0s - loss: 3.6339 - accuracy: 0.2646
6/8 [=====================>........] - ETA: 0s - loss: 3.6483 - accuracy: 0.2800
7/8 [=========================>....] - ETA: 0s - loss: 3.6894 - accuracy: 0.2484
8/8 [==============================] - 1s 74ms/step - loss: 3.6983 - accuracy: 0.2607

8/8 [==============================] - 1s 97ms/step - loss: 3.6983 - accuracy: 0.2607 - val_loss: 3.4218 - val_accuracy: 0.2220
Epoch 81/100

1/8 [==>...........................] - ETA: 0s - loss: 3.8566 - accuracy: 0.2170
2/8 [======>.......................] - ETA: 0s - loss: 3.7232 - accuracy: 0.2790
3/8 [==========>...................] - ETA: 0s - loss: 3.6605 - accuracy: 0.3013
4/8 [==============>...............] - ETA: 0s - loss: 3.6307 - accuracy: 0.3137
5/8 [=================>............] - ETA: 0s - loss: 3.5575 - accuracy: 0.2952
6/8 [=====================>........] - ETA: 0s - loss: 3.5230 - accuracy: 0.3035
7/8 [=========================>....] - ETA: 0s - loss: 3.4542 - accuracy: 0.3134
8/8 [==============================] - 1s 76ms/step - loss: 3.3828 - accuracy: 0.3201

8/8 [==============================] - 1s 99ms/step - loss: 3.3828 - accuracy: 0.3201 - val_loss: 3.0834 - val_accuracy: 0.0590
Epoch 82/100

1/8 [==>...........................] - ETA: 0s - loss: 3.1039 - accuracy: 0.0580
2/8 [======>.......................] - ETA: 0s - loss: 3.0637 - accuracy: 0.1965
3/8 [==========>...................] - ETA: 0s - loss: 3.0271 - accuracy: 0.2073
4/8 [==============>...............] - ETA: 0s - loss: 2.9588 - accuracy: 0.2445
5/8 [=================>............] - ETA: 0s - loss: 2.9341 - accuracy: 0.2700
6/8 [=====================>........] - ETA: 0s - loss: 2.8972 - accuracy: 0.2825
7/8 [=========================>....] - ETA: 0s - loss: 2.8869 - accuracy: 0.2743
8/8 [==============================] - 1s 77ms/step - loss: 2.8828 - accuracy: 0.2816

8/8 [==============================] - 1s 99ms/step - loss: 2.8828 - accuracy: 0.2816 - val_loss: 2.8264 - val_accuracy: 0.3540
Epoch 83/100

1/8 [==>...........................] - ETA: 0s - loss: 2.7741 - accuracy: 0.3600
2/8 [======>.......................] - ETA: 0s - loss: 2.8016 - accuracy: 0.3620
3/8 [==========>...................] - ETA: 0s - loss: 2.7763 - accuracy: 0.3557
4/8 [==============>...............] - ETA: 0s - loss: 2.8026 - accuracy: 0.3515
5/8 [=================>............] - ETA: 0s - loss: 2.7768 - accuracy: 0.3498
6/8 [=====================>........] - ETA: 0s - loss: 2.7853 - accuracy: 0.3458
7/8 [=========================>....] - ETA: 0s - loss: 2.7685 - accuracy: 0.3503
8/8 [==============================] - 1s 75ms/step - loss: 2.7446 - accuracy: 0.3514

8/8 [==============================] - 1s 97ms/step - loss: 2.7446 - accuracy: 0.3514 - val_loss: 2.8378 - val_accuracy: 0.3540
Epoch 84/100

1/8 [==>...........................] - ETA: 0s - loss: 2.7319 - accuracy: 0.3580
2/8 [======>.......................] - ETA: 0s - loss: 2.6940 - accuracy: 0.2845
3/8 [==========>...................] - ETA: 0s - loss: 2.7046 - accuracy: 0.3123
4/8 [==============>...............] - ETA: 0s - loss: 2.6973 - accuracy: 0.3235
5/8 [=================>............] - ETA: 0s - loss: 2.6884 - accuracy: 0.3234
6/8 [=====================>........] - ETA: 0s - loss: 2.6860 - accuracy: 0.3072
7/8 [=========================>....] - ETA: 0s - loss: 2.6787 - accuracy: 0.3153
8/8 [==============================] - 1s 76ms/step - loss: 2.7002 - accuracy: 0.3208

8/8 [==============================] - 1s 99ms/step - loss: 2.7002 - accuracy: 0.3208 - val_loss: 2.8547 - val_accuracy: 0.3540
Epoch 85/100

1/8 [==>...........................] - ETA: 0s - loss: 2.5700 - accuracy: 0.3370
2/8 [======>.......................] - ETA: 0s - loss: 2.7022 - accuracy: 0.2610
3/8 [==========>...................] - ETA: 0s - loss: 2.6599 - accuracy: 0.2933
4/8 [==============>...............] - ETA: 0s - loss: 2.6495 - accuracy: 0.3128
5/8 [=================>............] - ETA: 0s - loss: 2.6434 - accuracy: 0.2938
6/8 [=====================>........] - ETA: 0s - loss: 2.6273 - accuracy: 0.2802
7/8 [=========================>....] - ETA: 0s - loss: 2.6564 - accuracy: 0.2884
8/8 [==============================] - 1s 77ms/step - loss: 2.6807 - accuracy: 0.2927

8/8 [==============================] - 1s 100ms/step - loss: 2.6807 - accuracy: 0.2927 - val_loss: 2.8785 - val_accuracy: 0.2220
Epoch 86/100

1/8 [==>...........................] - ETA: 0s - loss: 2.8835 - accuracy: 0.2320
2/8 [======>.......................] - ETA: 0s - loss: 2.7434 - accuracy: 0.2360
3/8 [==========>...................] - ETA: 0s - loss: 2.7222 - accuracy: 0.2803
4/8 [==============>...............] - ETA: 0s - loss: 2.6499 - accuracy: 0.3018
5/8 [=================>............] - ETA: 0s - loss: 2.6245 - accuracy: 0.2874
6/8 [=====================>........] - ETA: 0s - loss: 2.6235 - accuracy: 0.2962
7/8 [=========================>....] - ETA: 0s - loss: 2.6152 - accuracy: 0.3061
8/8 [==============================] - 1s 77ms/step - loss: 2.6036 - accuracy: 0.3125

8/8 [==============================] - 1s 99ms/step - loss: 2.6036 - accuracy: 0.3125 - val_loss: 2.6578 - val_accuracy: 0.3540
Epoch 87/100

1/8 [==>...........................] - ETA: 0s - loss: 2.6408 - accuracy: 0.3470
2/8 [======>.......................] - ETA: 0s - loss: 2.5489 - accuracy: 0.3505
3/8 [==========>...................] - ETA: 0s - loss: 2.5529 - accuracy: 0.3573
4/8 [==============>...............] - ETA: 0s - loss: 2.5436 - accuracy: 0.3568
5/8 [=================>............] - ETA: 0s - loss: 2.5309 - accuracy: 0.3564
6/8 [=====================>........] - ETA: 0s - loss: 2.5121 - accuracy: 0.3563
7/8 [=========================>....] - ETA: 0s - loss: 2.5148 - accuracy: 0.3586
8/8 [==============================] - 1s 75ms/step - loss: 2.5349 - accuracy: 0.3514

8/8 [==============================] - 1s 98ms/step - loss: 2.5349 - accuracy: 0.3514 - val_loss: 2.5899 - val_accuracy: 0.2220
Epoch 88/100

1/8 [==>...........................] - ETA: 0s - loss: 2.5289 - accuracy: 0.2310
2/8 [======>.......................] - ETA: 0s - loss: 2.5020 - accuracy: 0.2890
3/8 [==========>...................] - ETA: 0s - loss: 2.4617 - accuracy: 0.3187
4/8 [==============>...............] - ETA: 0s - loss: 2.4820 - accuracy: 0.3230
5/8 [=================>............] - ETA: 0s - loss: 2.5477 - accuracy: 0.2584
6/8 [=====================>........] - ETA: 0s - loss: 2.5584 - accuracy: 0.2710
7/8 [=========================>....] - ETA: 0s - loss: 2.5432 - accuracy: 0.2824
8/8 [==============================] - 1s 78ms/step - loss: 2.5449 - accuracy: 0.2749

8/8 [==============================] - 1s 101ms/step - loss: 2.5449 - accuracy: 0.2749 - val_loss: 2.9023 - val_accuracy: 0.3540
Epoch 89/100

1/8 [==>...........................] - ETA: 0s - loss: 2.5924 - accuracy: 0.3520
2/8 [======>.......................] - ETA: 0s - loss: 2.5950 - accuracy: 0.3500
3/8 [==========>...................] - ETA: 0s - loss: 2.6944 - accuracy: 0.3003
4/8 [==============>...............] - ETA: 0s - loss: 2.7208 - accuracy: 0.3095
5/8 [=================>............] - ETA: 0s - loss: 2.7371 - accuracy: 0.3212
6/8 [=====================>........] - ETA: 0s - loss: 2.6953 - accuracy: 0.3258
7/8 [=========================>....] - ETA: 0s - loss: 2.6906 - accuracy: 0.3277
8/8 [==============================] - 1s 75ms/step - loss: 2.7717 - accuracy: 0.3285

8/8 [==============================] - 1s 98ms/step - loss: 2.7717 - accuracy: 0.3285 - val_loss: 3.3162 - val_accuracy: 0.3540
Epoch 90/100

1/8 [==>...........................] - ETA: 0s - loss: 2.6391 - accuracy: 0.3430
2/8 [======>.......................] - ETA: 0s - loss: 2.6502 - accuracy: 0.3375
3/8 [==========>...................] - ETA: 0s - loss: 2.7431 - accuracy: 0.3460
4/8 [==============>...............] - ETA: 0s - loss: 2.7174 - accuracy: 0.3528
5/8 [=================>............] - ETA: 0s - loss: 2.8797 - accuracy: 0.3482
6/8 [=====================>........] - ETA: 0s - loss: 2.8564 - accuracy: 0.3280
7/8 [=========================>....] - ETA: 0s - loss: 2.8719 - accuracy: 0.3330
8/8 [==============================] - 1s 76ms/step - loss: 2.9011 - accuracy: 0.3355

8/8 [==============================] - 1s 100ms/step - loss: 2.9011 - accuracy: 0.3355 - val_loss: 3.4719 - val_accuracy: 0.3540
Epoch 91/100

1/8 [==>...........................] - ETA: 0s - loss: 2.4445 - accuracy: 0.3680
2/8 [======>.......................] - ETA: 0s - loss: 2.7185 - accuracy: 0.2885
3/8 [==========>...................] - ETA: 0s - loss: 2.8679 - accuracy: 0.3207
4/8 [==============>...............] - ETA: 0s - loss: 3.1048 - accuracy: 0.3298
5/8 [=================>............] - ETA: 0s - loss: 2.9740 - accuracy: 0.3346
6/8 [=====================>........] - ETA: 0s - loss: 3.0755 - accuracy: 0.3155
7/8 [=========================>....] - ETA: 0s - loss: 3.0152 - accuracy: 0.3153
8/8 [==============================] - 1s 75ms/step - loss: 2.9536 - accuracy: 0.3190

8/8 [==============================] - 1s 98ms/step - loss: 2.9536 - accuracy: 0.3190 - val_loss: 3.4813 - val_accuracy: 0.2220
Epoch 92/100

1/8 [==>...........................] - ETA: 0s - loss: 2.7052 - accuracy: 0.2190
2/8 [======>.......................] - ETA: 0s - loss: 2.9840 - accuracy: 0.2880
3/8 [==========>...................] - ETA: 0s - loss: 3.0661 - accuracy: 0.3063
4/8 [==============>...............] - ETA: 0s - loss: 2.9371 - accuracy: 0.2790
5/8 [=================>............] - ETA: 0s - loss: 2.9446 - accuracy: 0.2936
6/8 [=====================>........] - ETA: 0s - loss: 3.0175 - accuracy: 0.2968
7/8 [=========================>....] - ETA: 0s - loss: 2.9839 - accuracy: 0.2864
8/8 [==============================] - 1s 77ms/step - loss: 2.9479 - accuracy: 0.2963

8/8 [==============================] - 1s 99ms/step - loss: 2.9479 - accuracy: 0.2963 - val_loss: 3.5342 - val_accuracy: 0.3540
Epoch 93/100

1/8 [==>...........................] - ETA: 0s - loss: 3.0414 - accuracy: 0.3570
2/8 [======>.......................] - ETA: 0s - loss: 3.0878 - accuracy: 0.3685
3/8 [==========>...................] - ETA: 0s - loss: 2.9802 - accuracy: 0.3220
4/8 [==============>...............] - ETA: 0s - loss: 3.0296 - accuracy: 0.3255
5/8 [=================>............] - ETA: 0s - loss: 3.0598 - accuracy: 0.3266
6/8 [=====================>........] - ETA: 0s - loss: 2.9844 - accuracy: 0.3040
7/8 [=========================>....] - ETA: 0s - loss: 2.9482 - accuracy: 0.3087
8/8 [==============================] - 1s 73ms/step - loss: 2.9163 - accuracy: 0.3146

8/8 [==============================] - 1s 96ms/step - loss: 2.9163 - accuracy: 0.3146 - val_loss: 3.3662 - val_accuracy: 0.2220
Epoch 94/100

1/8 [==>...........................] - ETA: 0s - loss: 2.4894 - accuracy: 0.2340
2/8 [======>.......................] - ETA: 0s - loss: 2.7168 - accuracy: 0.2300
3/8 [==========>...................] - ETA: 0s - loss: 2.7011 - accuracy: 0.2723
4/8 [==============>...............] - ETA: 0s - loss: 2.7572 - accuracy: 0.2937
5/8 [=================>............] - ETA: 0s - loss: 2.8192 - accuracy: 0.3082
6/8 [=====================>........] - ETA: 0s - loss: 2.9165 - accuracy: 0.3137
7/8 [=========================>....] - ETA: 0s - loss: 2.9114 - accuracy: 0.3203
8/8 [==============================] - 1s 73ms/step - loss: 2.8544 - accuracy: 0.3256

8/8 [==============================] - 1s 95ms/step - loss: 2.8544 - accuracy: 0.3256 - val_loss: 3.2559 - val_accuracy: 0.3540
Epoch 95/100

1/8 [==>...........................] - ETA: 0s - loss: 2.8483 - accuracy: 0.3440
2/8 [======>.......................] - ETA: 0s - loss: 2.9578 - accuracy: 0.3525
3/8 [==========>...................] - ETA: 0s - loss: 3.0540 - accuracy: 0.3573
4/8 [==============>...............] - ETA: 0s - loss: 2.9550 - accuracy: 0.3517
5/8 [=================>............] - ETA: 0s - loss: 2.8518 - accuracy: 0.3298
6/8 [=====================>........] - ETA: 0s - loss: 2.8921 - accuracy: 0.3340
7/8 [=========================>....] - ETA: 0s - loss: 2.8365 - accuracy: 0.3387
8/8 [==============================] - 1s 72ms/step - loss: 2.8080 - accuracy: 0.3401

8/8 [==============================] - 1s 95ms/step - loss: 2.8080 - accuracy: 0.3401 - val_loss: 3.1888 - val_accuracy: 0.2220
Epoch 96/100

1/8 [==>...........................] - ETA: 0s - loss: 2.8761 - accuracy: 0.2280
2/8 [======>.......................] - ETA: 0s - loss: 2.7867 - accuracy: 0.3005
3/8 [==========>...................] - ETA: 0s - loss: 2.7007 - accuracy: 0.3187
4/8 [==============>...............] - ETA: 0s - loss: 2.6495 - accuracy: 0.2898
5/8 [=================>............] - ETA: 0s - loss: 2.8074 - accuracy: 0.3022
6/8 [=====================>........] - ETA: 0s - loss: 2.7651 - accuracy: 0.3082
7/8 [=========================>....] - ETA: 0s - loss: 2.7435 - accuracy: 0.3153
8/8 [==============================] - 1s 74ms/step - loss: 2.7765 - accuracy: 0.3043

8/8 [==============================] - 1s 96ms/step - loss: 2.7765 - accuracy: 0.3043 - val_loss: 3.0635 - val_accuracy: 0.3540
Epoch 97/100

1/8 [==>...........................] - ETA: 0s - loss: 2.5863 - accuracy: 0.3570
2/8 [======>.......................] - ETA: 0s - loss: 2.6012 - accuracy: 0.3500
3/8 [==========>...................] - ETA: 0s - loss: 2.6193 - accuracy: 0.3467
4/8 [==============>...............] - ETA: 0s - loss: 2.6834 - accuracy: 0.3465
5/8 [=================>............] - ETA: 0s - loss: 2.6816 - accuracy: 0.3534
6/8 [=====================>........] - ETA: 0s - loss: 2.7563 - accuracy: 0.3533
7/8 [=========================>....] - ETA: 0s - loss: 2.7490 - accuracy: 0.3377
8/8 [==============================] - 1s 72ms/step - loss: 2.7174 - accuracy: 0.3400

8/8 [==============================] - 1s 94ms/step - loss: 2.7174 - accuracy: 0.3400 - val_loss: 3.0218 - val_accuracy: 0.3540
Epoch 98/100

1/8 [==>...........................] - ETA: 0s - loss: 2.6714 - accuracy: 0.3590
2/8 [======>.......................] - ETA: 0s - loss: 2.7088 - accuracy: 0.3460
3/8 [==========>...................] - ETA: 0s - loss: 2.7654 - accuracy: 0.3067
4/8 [==============>...............] - ETA: 0s - loss: 2.8005 - accuracy: 0.3153
5/8 [=================>............] - ETA: 0s - loss: 2.7750 - accuracy: 0.3230
6/8 [=====================>........] - ETA: 0s - loss: 2.7308 - accuracy: 0.3025
7/8 [=========================>....] - ETA: 0s - loss: 2.7323 - accuracy: 0.3134
8/8 [==============================] - 1s 71ms/step - loss: 2.7063 - accuracy: 0.3168

8/8 [==============================] - 1s 94ms/step - loss: 2.7063 - accuracy: 0.3168 - val_loss: 2.9327 - val_accuracy: 0.2220
Epoch 99/100

1/8 [==>...........................] - ETA: 0s - loss: 2.6454 - accuracy: 0.2110
2/8 [======>.......................] - ETA: 0s - loss: 2.8449 - accuracy: 0.2825
3/8 [==========>...................] - ETA: 0s - loss: 2.7770 - accuracy: 0.3040
4/8 [==============>...............] - ETA: 0s - loss: 2.7425 - accuracy: 0.3158
5/8 [=================>............] - ETA: 0s - loss: 2.7173 - accuracy: 0.2970
6/8 [=====================>........] - ETA: 0s - loss: 2.6952 - accuracy: 0.3048
7/8 [=========================>....] - ETA: 0s - loss: 2.7005 - accuracy: 0.3121
8/8 [==============================] - 1s 75ms/step - loss: 2.6743 - accuracy: 0.3173

8/8 [==============================] - 1s 97ms/step - loss: 2.6743 - accuracy: 0.3173 - val_loss: 2.7680 - val_accuracy: 0.3540
Epoch 100/100

1/8 [==>...........................] - ETA: 0s - loss: 2.5613 - accuracy: 0.3570
2/8 [======>.......................] - ETA: 0s - loss: 2.6289 - accuracy: 0.3475
3/8 [==========>...................] - ETA: 0s - loss: 2.6695 - accuracy: 0.3473
4/8 [==============>...............] - ETA: 0s - loss: 2.6315 - accuracy: 0.3528
5/8 [=================>............] - ETA: 0s - loss: 2.6488 - accuracy: 0.3490
6/8 [=====================>........] - ETA: 0s - loss: 2.6439 - accuracy: 0.3253
7/8 [=========================>....] - ETA: 0s - loss: 2.6395 - accuracy: 0.3277
8/8 [==============================] - 1s 67ms/step - loss: 2.6274 - accuracy: 0.3320

8/8 [==============================] - 1s 89ms/step - loss: 2.6274 - accuracy: 0.3320 - val_loss: 2.7410 - val_accuracy: 0.3540

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-01T18-50-06Z

Training run 6/8 (flags = list(392, 0.05, 200, 30, "tanh")) 
Using run directory runs/2020-11-01T18-51-34Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = 10000) %>%
+         layer_dense( units = FLAGS$n .... [TRUNCATED] 

> set.seed(123)

> model %>% compile (
+         loss = 'sparse_categorical_crossentropy',
+         optimizer = optimizer_adam(lr=FLAGS$learning_rate),
+         metr .... [TRUNCATED] 

> model %>% fit (x = reuters_train, y = reuters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = list(reuters_val .... [TRUNCATED] 
Epoch 1/30

 1/40 [..............................] - ETA: 0s - loss: 3.8510 - accuracy: 0.0000e+00
 4/40 [==>...........................] - ETA: 0s - loss: 7.2924 - accuracy: 0.2100    
 7/40 [====>.........................] - ETA: 0s - loss: 10.5200 - accuracy: 0.1493
10/40 [======>.......................] - ETA: 0s - loss: 13.0236 - accuracy: 0.1740
13/40 [========>.....................] - ETA: 0s - loss: 15.8028 - accuracy: 0.1677
16/40 [===========>..................] - ETA: 0s - loss: 17.1338 - accuracy: 0.1566
19/40 [=============>................] - ETA: 0s - loss: 18.4340 - accuracy: 0.1424
22/40 [===============>..............] - ETA: 0s - loss: 20.1381 - accuracy: 0.1502
25/40 [=================>............] - ETA: 0s - loss: 21.4379 - accuracy: 0.1562
28/40 [====================>.........] - ETA: 0s - loss: 22.4051 - accuracy: 0.1529
31/40 [======================>.......] - ETA: 0s - loss: 23.3082 - accuracy: 0.1476
33/40 [=======================>......] - ETA: 0s - loss: 23.6524 - accuracy: 0.1512
36/40 [==========================>...] - ETA: 0s - loss: 24.4696 - accuracy: 0.1624
39/40 [============================>.] - ETA: 0s - loss: 24.6525 - accuracy: 0.1694
40/40 [==============================] - 1s 23ms/step - loss: 24.7175 - accuracy: 0.1655

40/40 [==============================] - 2s 40ms/step - loss: 24.7175 - accuracy: 0.1655 - val_loss: 22.9209 - val_accuracy: 0.3540
Epoch 2/30

 1/40 [..............................] - ETA: 0s - loss: 19.1216 - accuracy: 0.3150
 4/40 [==>...........................] - ETA: 0s - loss: 20.4934 - accuracy: 0.2113
 7/40 [====>.........................] - ETA: 0s - loss: 20.0102 - accuracy: 0.1664
10/40 [======>.......................] - ETA: 0s - loss: 19.3942 - accuracy: 0.1945
13/40 [========>.....................] - ETA: 0s - loss: 19.3900 - accuracy: 0.2000
16/40 [===========>..................] - ETA: 0s - loss: 18.8126 - accuracy: 0.2066
19/40 [=============>................] - ETA: 0s - loss: 18.1948 - accuracy: 0.1968
22/40 [===============>..............] - ETA: 0s - loss: 17.7340 - accuracy: 0.1807
25/40 [=================>............] - ETA: 0s - loss: 17.3330 - accuracy: 0.1914
28/40 [====================>.........] - ETA: 0s - loss: 17.1160 - accuracy: 0.1991
31/40 [======================>.......] - ETA: 0s - loss: 17.0746 - accuracy: 0.1929
34/40 [========================>.....] - ETA: 0s - loss: 16.8287 - accuracy: 0.2031
36/40 [==========================>...] - ETA: 0s - loss: 16.6926 - accuracy: 0.1979
38/40 [===========================>..] - ETA: 0s - loss: 16.4105 - accuracy: 0.1979
40/40 [==============================] - 1s 24ms/step - loss: 16.1930 - accuracy: 0.2021

40/40 [==============================] - 1s 28ms/step - loss: 16.1930 - accuracy: 0.2021 - val_loss: 11.0827 - val_accuracy: 0.3540
Epoch 3/30

 1/40 [..............................] - ETA: 0s - loss: 10.0814 - accuracy: 0.3450
 4/40 [==>...........................] - ETA: 0s - loss: 11.8028 - accuracy: 0.2637
 7/40 [====>.........................] - ETA: 0s - loss: 10.3001 - accuracy: 0.2171
10/40 [======>.......................] - ETA: 0s - loss: 9.9341 - accuracy: 0.2395 
12/40 [========>.....................] - ETA: 0s - loss: 9.7673 - accuracy: 0.2621
15/40 [==========>...................] - ETA: 0s - loss: 9.6969 - accuracy: 0.2367
18/40 [============>.................] - ETA: 0s - loss: 9.4715 - accuracy: 0.2508
21/40 [==============>...............] - ETA: 0s - loss: 9.0913 - accuracy: 0.2560
24/40 [=================>............] - ETA: 0s - loss: 8.7388 - accuracy: 0.2506
27/40 [===================>..........] - ETA: 0s - loss: 8.5246 - accuracy: 0.2450
30/40 [=====================>........] - ETA: 0s - loss: 8.4148 - accuracy: 0.2488
33/40 [=======================>......] - ETA: 0s - loss: 8.2127 - accuracy: 0.2538
35/40 [=========================>....] - ETA: 0s - loss: 7.9924 - accuracy: 0.2563
37/40 [==========================>...] - ETA: 0s - loss: 7.8789 - accuracy: 0.2508
39/40 [============================>.] - ETA: 0s - loss: 7.8116 - accuracy: 0.2526
40/40 [==============================] - 1s 23ms/step - loss: 7.7456 - accuracy: 0.2517

40/40 [==============================] - 1s 28ms/step - loss: 7.7456 - accuracy: 0.2517 - val_loss: 5.7276 - val_accuracy: 0.0460
Epoch 4/30

 1/40 [..............................] - ETA: 0s - loss: 6.6049 - accuracy: 0.0500
 4/40 [==>...........................] - ETA: 0s - loss: 6.3775 - accuracy: 0.2562
 7/40 [====>.........................] - ETA: 0s - loss: 6.7009 - accuracy: 0.2700
10/40 [======>.......................] - ETA: 0s - loss: 6.2203 - accuracy: 0.2525
13/40 [========>.....................] - ETA: 0s - loss: 5.8973 - accuracy: 0.2562
16/40 [===========>..................] - ETA: 0s - loss: 5.7223 - accuracy: 0.2619
19/40 [=============>................] - ETA: 0s - loss: 5.5525 - accuracy: 0.2797
22/40 [===============>..............] - ETA: 0s - loss: 5.2992 - accuracy: 0.2925
25/40 [=================>............] - ETA: 0s - loss: 5.1911 - accuracy: 0.2942
28/40 [====================>.........] - ETA: 0s - loss: 5.0892 - accuracy: 0.2998
31/40 [======================>.......] - ETA: 0s - loss: 4.9566 - accuracy: 0.2990
34/40 [========================>.....] - ETA: 0s - loss: 4.7833 - accuracy: 0.2990
37/40 [==========================>...] - ETA: 0s - loss: 4.6920 - accuracy: 0.2984
40/40 [==============================] - 1s 23ms/step - loss: 4.6275 - accuracy: 0.3011

40/40 [==============================] - 1s 28ms/step - loss: 4.6275 - accuracy: 0.3011 - val_loss: 3.7288 - val_accuracy: 0.2220
Epoch 5/30

 1/40 [..............................] - ETA: 0s - loss: 3.0431 - accuracy: 0.2500
 4/40 [==>...........................] - ETA: 0s - loss: 3.4926 - accuracy: 0.2875
 7/40 [====>.........................] - ETA: 0s - loss: 3.8242 - accuracy: 0.2943
10/40 [======>.......................] - ETA: 0s - loss: 4.2044 - accuracy: 0.2645
12/40 [========>.....................] - ETA: 0s - loss: 4.1468 - accuracy: 0.2683
15/40 [==========>...................] - ETA: 0s - loss: 4.1446 - accuracy: 0.2537
17/40 [===========>..................] - ETA: 0s - loss: 4.1620 - accuracy: 0.2679
20/40 [==============>...............] - ETA: 0s - loss: 4.1143 - accuracy: 0.2715
22/40 [===============>..............] - ETA: 0s - loss: 4.2474 - accuracy: 0.2714
25/40 [=================>............] - ETA: 0s - loss: 4.3318 - accuracy: 0.2784
28/40 [====================>.........] - ETA: 0s - loss: 4.4380 - accuracy: 0.2820
31/40 [======================>.......] - ETA: 0s - loss: 4.3577 - accuracy: 0.2729
34/40 [========================>.....] - ETA: 0s - loss: 4.3022 - accuracy: 0.2718
37/40 [==========================>...] - ETA: 0s - loss: 4.3140 - accuracy: 0.2651
40/40 [==============================] - 1s 24ms/step - loss: 4.3789 - accuracy: 0.2684

40/40 [==============================] - 1s 29ms/step - loss: 4.3789 - accuracy: 0.2684 - val_loss: 5.0819 - val_accuracy: 0.2220
Epoch 6/30

 1/40 [..............................] - ETA: 0s - loss: 4.7126 - accuracy: 0.2400
 3/40 [=>............................] - ETA: 0s - loss: 5.0878 - accuracy: 0.3167
 6/40 [===>..........................] - ETA: 0s - loss: 4.5826 - accuracy: 0.3233
 8/40 [=====>........................] - ETA: 0s - loss: 4.4078 - accuracy: 0.2956
10/40 [======>.......................] - ETA: 0s - loss: 4.4529 - accuracy: 0.2780
13/40 [========>.....................] - ETA: 0s - loss: 4.5921 - accuracy: 0.2812
15/40 [==========>...................] - ETA: 0s - loss: 4.5349 - accuracy: 0.2687
17/40 [===========>..................] - ETA: 0s - loss: 4.4352 - accuracy: 0.2800
19/40 [=============>................] - ETA: 0s - loss: 4.4507 - accuracy: 0.2624
22/40 [===============>..............] - ETA: 0s - loss: 4.3702 - accuracy: 0.2630
24/40 [=================>............] - ETA: 0s - loss: 4.3558 - accuracy: 0.2708
26/40 [==================>...........] - ETA: 0s - loss: 4.3235 - accuracy: 0.2688
28/40 [====================>.........] - ETA: 0s - loss: 4.2700 - accuracy: 0.2789
31/40 [======================>.......] - ETA: 0s - loss: 4.2626 - accuracy: 0.2781
34/40 [========================>.....] - ETA: 0s - loss: 4.2217 - accuracy: 0.2756
36/40 [==========================>...] - ETA: 0s - loss: 4.1950 - accuracy: 0.2781
38/40 [===========================>..] - ETA: 0s - loss: 4.2247 - accuracy: 0.2700
40/40 [==============================] - 1s 25ms/step - loss: 4.2084 - accuracy: 0.2734

40/40 [==============================] - 1s 29ms/step - loss: 4.2084 - accuracy: 0.2734 - val_loss: 4.8105 - val_accuracy: 0.0250
Epoch 7/30

 1/40 [..............................] - ETA: 0s - loss: 4.2852 - accuracy: 0.0350
 3/40 [=>............................] - ETA: 0s - loss: 4.7380 - accuracy: 0.2117
 6/40 [===>..........................] - ETA: 0s - loss: 4.7938 - accuracy: 0.2100
 8/40 [=====>........................] - ETA: 0s - loss: 4.8287 - accuracy: 0.2400
10/40 [======>.......................] - ETA: 0s - loss: 4.8043 - accuracy: 0.2160
12/40 [========>.....................] - ETA: 0s - loss: 4.8048 - accuracy: 0.2083
15/40 [==========>...................] - ETA: 0s - loss: 4.9208 - accuracy: 0.2217
18/40 [============>.................] - ETA: 0s - loss: 5.0588 - accuracy: 0.2025
21/40 [==============>...............] - ETA: 0s - loss: 5.5325 - accuracy: 0.2245
24/40 [=================>............] - ETA: 0s - loss: 5.8459 - accuracy: 0.2354
27/40 [===================>..........] - ETA: 0s - loss: 6.0949 - accuracy: 0.2420
30/40 [=====================>........] - ETA: 0s - loss: 6.1106 - accuracy: 0.2402
33/40 [=======================>......] - ETA: 0s - loss: 6.0322 - accuracy: 0.2353
35/40 [=========================>....] - ETA: 0s - loss: 5.9731 - accuracy: 0.2401
37/40 [==========================>...] - ETA: 0s - loss: 5.9158 - accuracy: 0.2355
39/40 [============================>.] - ETA: 0s - loss: 5.8465 - accuracy: 0.2436
40/40 [==============================] - 1s 25ms/step - loss: 5.8128 - accuracy: 0.2420

40/40 [==============================] - 1s 30ms/step - loss: 5.8128 - accuracy: 0.2420 - val_loss: 4.3413 - val_accuracy: 0.3540
Epoch 8/30

 1/40 [..............................] - ETA: 0s - loss: 4.3552 - accuracy: 0.3300
 3/40 [=>............................] - ETA: 0s - loss: 4.6752 - accuracy: 0.2650
 6/40 [===>..........................] - ETA: 0s - loss: 4.5795 - accuracy: 0.2375
 8/40 [=====>........................] - ETA: 0s - loss: 4.6537 - accuracy: 0.2237
10/40 [======>.......................] - ETA: 0s - loss: 4.7375 - accuracy: 0.2400
12/40 [========>.....................] - ETA: 0s - loss: 4.7736 - accuracy: 0.2383
14/40 [=========>....................] - ETA: 0s - loss: 4.8272 - accuracy: 0.2436
16/40 [===========>..................] - ETA: 0s - loss: 4.9724 - accuracy: 0.2194
18/40 [============>.................] - ETA: 0s - loss: 5.0073 - accuracy: 0.2275
20/40 [==============>...............] - ETA: 0s - loss: 5.0261 - accuracy: 0.2240
22/40 [===============>..............] - ETA: 0s - loss: 5.0476 - accuracy: 0.2275
24/40 [=================>............] - ETA: 0s - loss: 5.0049 - accuracy: 0.2194
26/40 [==================>...........] - ETA: 0s - loss: 5.0451 - accuracy: 0.2294
28/40 [====================>.........] - ETA: 0s - loss: 5.1277 - accuracy: 0.2246
30/40 [=====================>........] - ETA: 0s - loss: 5.1600 - accuracy: 0.2240
32/40 [=======================>......] - ETA: 0s - loss: 5.2623 - accuracy: 0.2266
35/40 [=========================>....] - ETA: 0s - loss: 5.4871 - accuracy: 0.2279
37/40 [==========================>...] - ETA: 0s - loss: 5.6947 - accuracy: 0.2214
39/40 [============================>.] - ETA: 0s - loss: 5.8936 - accuracy: 0.2271
40/40 [==============================] - 1s 26ms/step - loss: 5.9123 - accuracy: 0.2220

40/40 [==============================] - 1s 31ms/step - loss: 5.9123 - accuracy: 0.2220 - val_loss: 6.5140 - val_accuracy: 0.2220
Epoch 9/30

 1/40 [..............................] - ETA: 0s - loss: 6.4423 - accuracy: 0.2350
 3/40 [=>............................] - ETA: 0s - loss: 6.4069 - accuracy: 0.2033
 6/40 [===>..........................] - ETA: 0s - loss: 6.6421 - accuracy: 0.2292
 8/40 [=====>........................] - ETA: 0s - loss: 6.8501 - accuracy: 0.2163
10/40 [======>.......................] - ETA: 0s - loss: 7.1424 - accuracy: 0.1845
12/40 [========>.....................] - ETA: 0s - loss: 7.6017 - accuracy: 0.1963
14/40 [=========>....................] - ETA: 0s - loss: 8.0554 - accuracy: 0.2079
16/40 [===========>..................] - ETA: 0s - loss: 8.4141 - accuracy: 0.2225
19/40 [=============>................] - ETA: 0s - loss: 8.1678 - accuracy: 0.2368
21/40 [==============>...............] - ETA: 0s - loss: 8.2161 - accuracy: 0.2424
23/40 [================>.............] - ETA: 0s - loss: 8.3071 - accuracy: 0.2352
25/40 [=================>............] - ETA: 0s - loss: 8.2573 - accuracy: 0.2236
27/40 [===================>..........] - ETA: 0s - loss: 8.5038 - accuracy: 0.2211
29/40 [====================>.........] - ETA: 0s - loss: 8.6036 - accuracy: 0.2147
31/40 [======================>.......] - ETA: 0s - loss: 8.5776 - accuracy: 0.2137
33/40 [=======================>......] - ETA: 0s - loss: 8.7628 - accuracy: 0.2189
35/40 [=========================>....] - ETA: 0s - loss: 8.7667 - accuracy: 0.2244
37/40 [==========================>...] - ETA: 0s - loss: 8.8046 - accuracy: 0.2314
39/40 [============================>.] - ETA: 0s - loss: 8.7936 - accuracy: 0.2335
40/40 [==============================] - 1s 25ms/step - loss: 8.7536 - accuracy: 0.2295

40/40 [==============================] - 1s 30ms/step - loss: 8.7536 - accuracy: 0.2295 - val_loss: 7.9836 - val_accuracy: 0.3540
Epoch 10/30

 1/40 [..............................] - ETA: 0s - loss: 5.7649 - accuracy: 0.3500
 3/40 [=>............................] - ETA: 0s - loss: 7.4844 - accuracy: 0.3367
 5/40 [==>...........................] - ETA: 0s - loss: 7.8409 - accuracy: 0.2780
 8/40 [=====>........................] - ETA: 0s - loss: 8.3248 - accuracy: 0.3025
10/40 [======>.......................] - ETA: 0s - loss: 8.5657 - accuracy: 0.2990
12/40 [========>.....................] - ETA: 0s - loss: 8.7066 - accuracy: 0.2817
14/40 [=========>....................] - ETA: 0s - loss: 8.7673 - accuracy: 0.2600
16/40 [===========>..................] - ETA: 0s - loss: 9.0598 - accuracy: 0.2525
18/40 [============>.................] - ETA: 0s - loss: 9.2593 - accuracy: 0.2531
20/40 [==============>...............] - ETA: 0s - loss: 9.2310 - accuracy: 0.2317
22/40 [===============>..............] - ETA: 0s - loss: 9.5094 - accuracy: 0.2418
24/40 [=================>............] - ETA: 0s - loss: 9.7549 - accuracy: 0.2315
26/40 [==================>...........] - ETA: 0s - loss: 9.8263 - accuracy: 0.2365
28/40 [====================>.........] - ETA: 0s - loss: 9.7796 - accuracy: 0.2332
30/40 [=====================>........] - ETA: 0s - loss: 9.7850 - accuracy: 0.2372
32/40 [=======================>......] - ETA: 0s - loss: 9.7387 - accuracy: 0.2244
34/40 [========================>.....] - ETA: 0s - loss: 9.6833 - accuracy: 0.2232
36/40 [==========================>...] - ETA: 0s - loss: 9.9422 - accuracy: 0.2186
38/40 [===========================>..] - ETA: 0s - loss: 9.9681 - accuracy: 0.2268
40/40 [==============================] - 1s 26ms/step - loss: 10.1415 - accuracy: 0.2212

40/40 [==============================] - 1s 31ms/step - loss: 10.1415 - accuracy: 0.2212 - val_loss: 12.6992 - val_accuracy: 0.0060
Epoch 11/30

 1/40 [..............................] - ETA: 0s - loss: 11.3325 - accuracy: 0.0050
 3/40 [=>............................] - ETA: 0s - loss: 12.7654 - accuracy: 0.2483
 5/40 [==>...........................] - ETA: 0s - loss: 11.9468 - accuracy: 0.2640
 7/40 [====>.........................] - ETA: 0s - loss: 11.4138 - accuracy: 0.2457
 9/40 [=====>........................] - ETA: 0s - loss: 11.5246 - accuracy: 0.2383
11/40 [=======>......................] - ETA: 0s - loss: 11.6001 - accuracy: 0.2355
13/40 [========>.....................] - ETA: 0s - loss: 11.8262 - accuracy: 0.2038
15/40 [==========>...................] - ETA: 0s - loss: 12.5326 - accuracy: 0.1997
17/40 [===========>..................] - ETA: 0s - loss: 13.0278 - accuracy: 0.2062
19/40 [=============>................] - ETA: 0s - loss: 12.9024 - accuracy: 0.1845
21/40 [==============>...............] - ETA: 0s - loss: 12.9883 - accuracy: 0.1938
23/40 [================>.............] - ETA: 0s - loss: 12.9557 - accuracy: 0.1948
25/40 [=================>............] - ETA: 0s - loss: 12.8349 - accuracy: 0.1908
27/40 [===================>..........] - ETA: 0s - loss: 12.9218 - accuracy: 0.2028
29/40 [====================>.........] - ETA: 0s - loss: 12.9677 - accuracy: 0.1978
31/40 [======================>.......] - ETA: 0s - loss: 13.0621 - accuracy: 0.2029
33/40 [=======================>......] - ETA: 0s - loss: 13.2044 - accuracy: 0.1938
35/40 [=========================>....] - ETA: 0s - loss: 13.5177 - accuracy: 0.1983
37/40 [==========================>...] - ETA: 0s - loss: 13.6865 - accuracy: 0.2074
39/40 [============================>.] - ETA: 0s - loss: 13.7608 - accuracy: 0.2024
40/40 [==============================] - 1s 27ms/step - loss: 13.8740 - accuracy: 0.1986

40/40 [==============================] - 1s 32ms/step - loss: 13.8740 - accuracy: 0.1986 - val_loss: 13.8505 - val_accuracy: 0.3540
Epoch 12/30

 1/40 [..............................] - ETA: 0s - loss: 14.3720 - accuracy: 0.4100
 3/40 [=>............................] - ETA: 0s - loss: 14.1143 - accuracy: 0.3167
 5/40 [==>...........................] - ETA: 0s - loss: 14.9048 - accuracy: 0.2590
 7/40 [====>.........................] - ETA: 0s - loss: 14.2169 - accuracy: 0.1957
 9/40 [=====>........................] - ETA: 0s - loss: 14.3223 - accuracy: 0.2011
11/40 [=======>......................] - ETA: 0s - loss: 13.7887 - accuracy: 0.2100
13/40 [========>.....................] - ETA: 0s - loss: 13.8874 - accuracy: 0.2019
15/40 [==========>...................] - ETA: 0s - loss: 13.6778 - accuracy: 0.2257
17/40 [===========>..................] - ETA: 0s - loss: 13.2998 - accuracy: 0.2041
19/40 [=============>................] - ETA: 0s - loss: 13.1501 - accuracy: 0.2176
21/40 [==============>...............] - ETA: 0s - loss: 13.0521 - accuracy: 0.2167
23/40 [================>.............] - ETA: 0s - loss: 13.1754 - accuracy: 0.2133
25/40 [=================>............] - ETA: 0s - loss: 13.1682 - accuracy: 0.2166
27/40 [===================>..........] - ETA: 0s - loss: 13.0274 - accuracy: 0.2241
29/40 [====================>.........] - ETA: 0s - loss: 12.9880 - accuracy: 0.2121
31/40 [======================>.......] - ETA: 0s - loss: 12.9691 - accuracy: 0.2147
33/40 [=======================>......] - ETA: 0s - loss: 12.9204 - accuracy: 0.2217
35/40 [=========================>....] - ETA: 0s - loss: 12.6912 - accuracy: 0.2194
37/40 [==========================>...] - ETA: 0s - loss: 12.5644 - accuracy: 0.2174
39/40 [============================>.] - ETA: 0s - loss: 12.3457 - accuracy: 0.2086
40/40 [==============================] - 1s 27ms/step - loss: 12.2178 - accuracy: 0.2120

40/40 [==============================] - 1s 32ms/step - loss: 12.2178 - accuracy: 0.2120 - val_loss: 7.7883 - val_accuracy: 0.3540
Epoch 13/30

 1/40 [..............................] - ETA: 0s - loss: 7.4274 - accuracy: 0.3500
 3/40 [=>............................] - ETA: 0s - loss: 8.9858 - accuracy: 0.1450
 5/40 [==>...........................] - ETA: 0s - loss: 8.5749 - accuracy: 0.2320
 7/40 [====>.........................] - ETA: 0s - loss: 8.3448 - accuracy: 0.2464
 9/40 [=====>........................] - ETA: 0s - loss: 8.6308 - accuracy: 0.2372
11/40 [=======>......................] - ETA: 0s - loss: 8.6255 - accuracy: 0.2568
13/40 [========>.....................] - ETA: 0s - loss: 8.7686 - accuracy: 0.2458
15/40 [==========>...................] - ETA: 0s - loss: 8.9089 - accuracy: 0.2317
17/40 [===========>..................] - ETA: 0s - loss: 8.8416 - accuracy: 0.2259
19/40 [=============>................] - ETA: 0s - loss: 8.9128 - accuracy: 0.2282
21/40 [==============>...............] - ETA: 0s - loss: 8.8746 - accuracy: 0.2286
23/40 [================>.............] - ETA: 0s - loss: 8.9255 - accuracy: 0.2224
25/40 [=================>............] - ETA: 0s - loss: 8.9037 - accuracy: 0.2200
27/40 [===================>..........] - ETA: 0s - loss: 9.0185 - accuracy: 0.2206
29/40 [====================>.........] - ETA: 0s - loss: 9.1235 - accuracy: 0.2219
31/40 [======================>.......] - ETA: 0s - loss: 9.1298 - accuracy: 0.2247
33/40 [=======================>......] - ETA: 0s - loss: 9.0266 - accuracy: 0.2230
35/40 [=========================>....] - ETA: 0s - loss: 8.9811 - accuracy: 0.2300
37/40 [==========================>...] - ETA: 0s - loss: 9.0247 - accuracy: 0.2346
39/40 [============================>.] - ETA: 0s - loss: 9.0459 - accuracy: 0.2328
40/40 [==============================] - 1s 26ms/step - loss: 9.0418 - accuracy: 0.2360

40/40 [==============================] - 1s 31ms/step - loss: 9.0418 - accuracy: 0.2360 - val_loss: 8.1313 - val_accuracy: 0.2220
Epoch 14/30

 1/40 [..............................] - ETA: 0s - loss: 6.0689 - accuracy: 0.2650
 3/40 [=>............................] - ETA: 0s - loss: 6.5281 - accuracy: 0.2817
 5/40 [==>...........................] - ETA: 0s - loss: 7.2812 - accuracy: 0.2320
 7/40 [====>.........................] - ETA: 0s - loss: 7.1206 - accuracy: 0.2643
 9/40 [=====>........................] - ETA: 0s - loss: 7.5782 - accuracy: 0.2894
11/40 [=======>......................] - ETA: 0s - loss: 7.5986 - accuracy: 0.2405
13/40 [========>.....................] - ETA: 0s - loss: 7.6280 - accuracy: 0.2558
15/40 [==========>...................] - ETA: 0s - loss: 7.5595 - accuracy: 0.2727
17/40 [===========>..................] - ETA: 0s - loss: 7.6487 - accuracy: 0.2626
19/40 [=============>................] - ETA: 0s - loss: 7.7635 - accuracy: 0.2629
21/40 [==============>...............] - ETA: 0s - loss: 7.6964 - accuracy: 0.2650
23/40 [================>.............] - ETA: 0s - loss: 7.4378 - accuracy: 0.2741
25/40 [=================>............] - ETA: 0s - loss: 7.3360 - accuracy: 0.2778
27/40 [===================>..........] - ETA: 0s - loss: 7.3149 - accuracy: 0.2704
29/40 [====================>.........] - ETA: 0s - loss: 7.2774 - accuracy: 0.2712
31/40 [======================>.......] - ETA: 0s - loss: 7.2454 - accuracy: 0.2758
33/40 [=======================>......] - ETA: 0s - loss: 7.1646 - accuracy: 0.2605
35/40 [=========================>....] - ETA: 0s - loss: 7.1934 - accuracy: 0.2567
37/40 [==========================>...] - ETA: 0s - loss: 7.1286 - accuracy: 0.2539
39/40 [============================>.] - ETA: 0s - loss: 7.2216 - accuracy: 0.2533
40/40 [==============================] - 1s 26ms/step - loss: 7.1973 - accuracy: 0.2551

40/40 [==============================] - 1s 31ms/step - loss: 7.1973 - accuracy: 0.2551 - val_loss: 8.7202 - val_accuracy: 0.3540
Epoch 15/30

 1/40 [..............................] - ETA: 0s - loss: 6.1745 - accuracy: 0.4250
 3/40 [=>............................] - ETA: 0s - loss: 6.3624 - accuracy: 0.3333
 5/40 [==>...........................] - ETA: 0s - loss: 6.2745 - accuracy: 0.3470
 7/40 [====>.........................] - ETA: 0s - loss: 7.1926 - accuracy: 0.3364
10/40 [======>.......................] - ETA: 0s - loss: 6.7652 - accuracy: 0.3255
12/40 [========>.....................] - ETA: 0s - loss: 6.7292 - accuracy: 0.3046
14/40 [=========>....................] - ETA: 0s - loss: 6.8405 - accuracy: 0.2989
16/40 [===========>..................] - ETA: 0s - loss: 6.7879 - accuracy: 0.3019
18/40 [============>.................] - ETA: 0s - loss: 6.9612 - accuracy: 0.2867
20/40 [==============>...............] - ETA: 0s - loss: 7.0353 - accuracy: 0.2875
22/40 [===============>..............] - ETA: 0s - loss: 7.1209 - accuracy: 0.2905
25/40 [=================>............] - ETA: 0s - loss: 7.3174 - accuracy: 0.2934
27/40 [===================>..........] - ETA: 0s - loss: 7.2822 - accuracy: 0.2809
29/40 [====================>.........] - ETA: 0s - loss: 7.3339 - accuracy: 0.2864
31/40 [======================>.......] - ETA: 0s - loss: 7.2840 - accuracy: 0.2874
33/40 [=======================>......] - ETA: 0s - loss: 7.3438 - accuracy: 0.2902
35/40 [=========================>....] - ETA: 0s - loss: 7.3224 - accuracy: 0.2851
37/40 [==========================>...] - ETA: 0s - loss: 7.2431 - accuracy: 0.2847
39/40 [============================>.] - ETA: 0s - loss: 7.2320 - accuracy: 0.2865
40/40 [==============================] - 1s 26ms/step - loss: 7.2218 - accuracy: 0.2856

40/40 [==============================] - 1s 31ms/step - loss: 7.2218 - accuracy: 0.2856 - val_loss: 6.2125 - val_accuracy: 0.3540
Epoch 16/30

 1/40 [..............................] - ETA: 0s - loss: 6.9100 - accuracy: 0.3100
 3/40 [=>............................] - ETA: 0s - loss: 5.5993 - accuracy: 0.3700
 6/40 [===>..........................] - ETA: 0s - loss: 6.2978 - accuracy: 0.2467
 8/40 [=====>........................] - ETA: 0s - loss: 6.5483 - accuracy: 0.2619
10/40 [======>.......................] - ETA: 0s - loss: 6.7471 - accuracy: 0.2530
12/40 [========>.....................] - ETA: 0s - loss: 6.9612 - accuracy: 0.2571
14/40 [=========>....................] - ETA: 0s - loss: 6.9746 - accuracy: 0.2707
16/40 [===========>..................] - ETA: 0s - loss: 7.0110 - accuracy: 0.2688
18/40 [============>.................] - ETA: 0s - loss: 6.9931 - accuracy: 0.2600
20/40 [==============>...............] - ETA: 0s - loss: 6.8115 - accuracy: 0.2718
22/40 [===============>..............] - ETA: 0s - loss: 6.6688 - accuracy: 0.2768
24/40 [=================>............] - ETA: 0s - loss: 6.5403 - accuracy: 0.2829
26/40 [==================>...........] - ETA: 0s - loss: 6.6090 - accuracy: 0.2813
28/40 [====================>.........] - ETA: 0s - loss: 6.4404 - accuracy: 0.2809
30/40 [=====================>........] - ETA: 0s - loss: 6.3477 - accuracy: 0.2853
32/40 [=======================>......] - ETA: 0s - loss: 6.3529 - accuracy: 0.2753
34/40 [========================>.....] - ETA: 0s - loss: 6.3152 - accuracy: 0.2696
36/40 [==========================>...] - ETA: 0s - loss: 6.2571 - accuracy: 0.2751
38/40 [===========================>..] - ETA: 0s - loss: 6.2159 - accuracy: 0.2733
40/40 [==============================] - 1s 25ms/step - loss: 6.2246 - accuracy: 0.2771

40/40 [==============================] - 1s 30ms/step - loss: 6.2246 - accuracy: 0.2771 - val_loss: 6.4334 - val_accuracy: 0.2220
Epoch 17/30

 1/40 [..............................] - ETA: 0s - loss: 4.9485 - accuracy: 0.2600
 3/40 [=>............................] - ETA: 0s - loss: 6.0855 - accuracy: 0.3117
 6/40 [===>..........................] - ETA: 0s - loss: 5.7800 - accuracy: 0.2783
 8/40 [=====>........................] - ETA: 0s - loss: 5.7712 - accuracy: 0.2700
10/40 [======>.......................] - ETA: 0s - loss: 5.7986 - accuracy: 0.2790
12/40 [========>.....................] - ETA: 0s - loss: 5.8026 - accuracy: 0.2475
14/40 [=========>....................] - ETA: 0s - loss: 5.9042 - accuracy: 0.2364
16/40 [===========>..................] - ETA: 0s - loss: 6.0351 - accuracy: 0.2397
18/40 [============>.................] - ETA: 0s - loss: 6.0928 - accuracy: 0.2558
20/40 [==============>...............] - ETA: 0s - loss: 6.0096 - accuracy: 0.2560
22/40 [===============>..............] - ETA: 0s - loss: 5.9114 - accuracy: 0.2566
24/40 [=================>............] - ETA: 0s - loss: 5.8469 - accuracy: 0.2633
26/40 [==================>...........] - ETA: 0s - loss: 5.8590 - accuracy: 0.2638
28/40 [====================>.........] - ETA: 0s - loss: 5.7970 - accuracy: 0.2721
30/40 [=====================>........] - ETA: 0s - loss: 5.7276 - accuracy: 0.2615
32/40 [=======================>......] - ETA: 0s - loss: 5.7158 - accuracy: 0.2606
34/40 [========================>.....] - ETA: 0s - loss: 5.7071 - accuracy: 0.2637
36/40 [==========================>...] - ETA: 0s - loss: 5.7049 - accuracy: 0.2664
38/40 [===========================>..] - ETA: 0s - loss: 5.6524 - accuracy: 0.2668
40/40 [==============================] - 1s 26ms/step - loss: 5.5710 - accuracy: 0.2681

40/40 [==============================] - 1s 30ms/step - loss: 5.5710 - accuracy: 0.2681 - val_loss: 4.5116 - val_accuracy: 0.3540
Epoch 18/30

 1/40 [..............................] - ETA: 0s - loss: 6.6293 - accuracy: 0.3650
 3/40 [=>............................] - ETA: 0s - loss: 6.4273 - accuracy: 0.3517
 6/40 [===>..........................] - ETA: 0s - loss: 5.7277 - accuracy: 0.3142
 8/40 [=====>........................] - ETA: 0s - loss: 5.2990 - accuracy: 0.3013
11/40 [=======>......................] - ETA: 0s - loss: 4.9881 - accuracy: 0.3164
13/40 [========>.....................] - ETA: 0s - loss: 4.9825 - accuracy: 0.3142
15/40 [==========>...................] - ETA: 0s - loss: 4.9302 - accuracy: 0.3177
17/40 [===========>..................] - ETA: 0s - loss: 4.7513 - accuracy: 0.3129
20/40 [==============>...............] - ETA: 0s - loss: 4.5697 - accuracy: 0.3165
22/40 [===============>..............] - ETA: 0s - loss: 4.5511 - accuracy: 0.3148
24/40 [=================>............] - ETA: 0s - loss: 4.5932 - accuracy: 0.3140
27/40 [===================>..........] - ETA: 0s - loss: 4.6842 - accuracy: 0.3098
29/40 [====================>.........] - ETA: 0s - loss: 4.7085 - accuracy: 0.3126
31/40 [======================>.......] - ETA: 0s - loss: 4.8175 - accuracy: 0.3126
33/40 [=======================>......] - ETA: 0s - loss: 4.8009 - accuracy: 0.3161
35/40 [=========================>....] - ETA: 0s - loss: 4.7997 - accuracy: 0.3114
37/40 [==========================>...] - ETA: 0s - loss: 4.7095 - accuracy: 0.3050
40/40 [==============================] - 1s 25ms/step - loss: 4.7009 - accuracy: 0.3059

40/40 [==============================] - 1s 30ms/step - loss: 4.7009 - accuracy: 0.3059 - val_loss: 4.3107 - val_accuracy: 0.0060
Epoch 19/30

 1/40 [..............................] - ETA: 0s - loss: 3.6266 - accuracy: 0.0100
 4/40 [==>...........................] - ETA: 0s - loss: 3.2392 - accuracy: 0.2625
 7/40 [====>.........................] - ETA: 0s - loss: 4.0868 - accuracy: 0.3100
10/40 [======>.......................] - ETA: 0s - loss: 4.4650 - accuracy: 0.3105
13/40 [========>.....................] - ETA: 0s - loss: 4.8251 - accuracy: 0.2815
15/40 [==========>...................] - ETA: 0s - loss: 4.7457 - accuracy: 0.2800
17/40 [===========>..................] - ETA: 0s - loss: 4.6781 - accuracy: 0.2741
20/40 [==============>...............] - ETA: 0s - loss: 4.6171 - accuracy: 0.2820
22/40 [===============>..............] - ETA: 0s - loss: 4.7079 - accuracy: 0.2816
24/40 [=================>............] - ETA: 0s - loss: 4.6846 - accuracy: 0.2817
26/40 [==================>...........] - ETA: 0s - loss: 4.7138 - accuracy: 0.2815
28/40 [====================>.........] - ETA: 0s - loss: 4.6944 - accuracy: 0.2789
30/40 [=====================>........] - ETA: 0s - loss: 4.6897 - accuracy: 0.2703
32/40 [=======================>......] - ETA: 0s - loss: 4.6404 - accuracy: 0.2722
34/40 [========================>.....] - ETA: 0s - loss: 4.6008 - accuracy: 0.2751
36/40 [==========================>...] - ETA: 0s - loss: 4.6154 - accuracy: 0.2739
39/40 [============================>.] - ETA: 0s - loss: 4.6150 - accuracy: 0.2677
40/40 [==============================] - 1s 25ms/step - loss: 4.7085 - accuracy: 0.2700

40/40 [==============================] - 1s 29ms/step - loss: 4.7085 - accuracy: 0.2700 - val_loss: 6.2235 - val_accuracy: 0.3540
Epoch 20/30

 1/40 [..............................] - ETA: 0s - loss: 5.9686 - accuracy: 0.3500
 4/40 [==>...........................] - ETA: 0s - loss: 6.1546 - accuracy: 0.2688
 7/40 [====>.........................] - ETA: 0s - loss: 6.0251 - accuracy: 0.2621
10/40 [======>.......................] - ETA: 0s - loss: 5.7493 - accuracy: 0.2705
12/40 [========>.....................] - ETA: 0s - loss: 5.7274 - accuracy: 0.2417
15/40 [==========>...................] - ETA: 0s - loss: 6.0764 - accuracy: 0.2303
17/40 [===========>..................] - ETA: 0s - loss: 6.2731 - accuracy: 0.2488
20/40 [==============>...............] - ETA: 0s - loss: 6.3322 - accuracy: 0.2295
23/40 [================>.............] - ETA: 0s - loss: 6.4685 - accuracy: 0.2402
26/40 [==================>...........] - ETA: 0s - loss: 6.7894 - accuracy: 0.2385
28/40 [====================>.........] - ETA: 0s - loss: 6.8267 - accuracy: 0.2463
31/40 [======================>.......] - ETA: 0s - loss: 6.8717 - accuracy: 0.2373
33/40 [=======================>......] - ETA: 0s - loss: 6.8577 - accuracy: 0.2391
35/40 [=========================>....] - ETA: 0s - loss: 6.8385 - accuracy: 0.2284
37/40 [==========================>...] - ETA: 0s - loss: 6.8541 - accuracy: 0.2376
39/40 [============================>.] - ETA: 0s - loss: 6.9767 - accuracy: 0.2400
40/40 [==============================] - 1s 25ms/step - loss: 7.0711 - accuracy: 0.2422

40/40 [==============================] - 1s 29ms/step - loss: 7.0711 - accuracy: 0.2422 - val_loss: 9.2903 - val_accuracy: 0.2220
Epoch 21/30

 1/40 [..............................] - ETA: 0s - loss: 9.2033 - accuracy: 0.2750
 4/40 [==>...........................] - ETA: 0s - loss: 8.8767 - accuracy: 0.2075
 7/40 [====>.........................] - ETA: 0s - loss: 8.6227 - accuracy: 0.1957
 9/40 [=====>........................] - ETA: 0s - loss: 7.9960 - accuracy: 0.2139
11/40 [=======>......................] - ETA: 0s - loss: 7.9674 - accuracy: 0.2177
14/40 [=========>....................] - ETA: 0s - loss: 7.8978 - accuracy: 0.2161
17/40 [===========>..................] - ETA: 0s - loss: 7.9661 - accuracy: 0.2265
20/40 [==============>...............] - ETA: 0s - loss: 7.9483 - accuracy: 0.2307
22/40 [===============>..............] - ETA: 0s - loss: 8.0099 - accuracy: 0.2393
24/40 [=================>............] - ETA: 0s - loss: 7.8241 - accuracy: 0.2463
27/40 [===================>..........] - ETA: 0s - loss: 7.9120 - accuracy: 0.2604
29/40 [====================>.........] - ETA: 0s - loss: 7.9627 - accuracy: 0.2514
31/40 [======================>.......] - ETA: 0s - loss: 8.0524 - accuracy: 0.2577
33/40 [=======================>......] - ETA: 0s - loss: 8.0334 - accuracy: 0.2492
35/40 [=========================>....] - ETA: 0s - loss: 7.9730 - accuracy: 0.2479
37/40 [==========================>...] - ETA: 0s - loss: 8.1133 - accuracy: 0.2489
40/40 [==============================] - 1s 25ms/step - loss: 8.2140 - accuracy: 0.2405

40/40 [==============================] - 1s 29ms/step - loss: 8.2140 - accuracy: 0.2405 - val_loss: 9.8031 - val_accuracy: 0.3540
Epoch 22/30

 1/40 [..............................] - ETA: 0s - loss: 9.0834 - accuracy: 0.3500
 4/40 [==>...........................] - ETA: 0s - loss: 9.2667 - accuracy: 0.2537
 7/40 [====>.........................] - ETA: 0s - loss: 10.2300 - accuracy: 0.2321
 9/40 [=====>........................] - ETA: 0s - loss: 10.5963 - accuracy: 0.2200
11/40 [=======>......................] - ETA: 0s - loss: 10.7865 - accuracy: 0.2123
14/40 [=========>....................] - ETA: 0s - loss: 10.7241 - accuracy: 0.1907
16/40 [===========>..................] - ETA: 0s - loss: 10.8901 - accuracy: 0.2025
18/40 [============>.................] - ETA: 0s - loss: 10.7478 - accuracy: 0.2058
20/40 [==============>...............] - ETA: 0s - loss: 10.7311 - accuracy: 0.2013
22/40 [===============>..............] - ETA: 0s - loss: 10.8243 - accuracy: 0.2066
24/40 [=================>............] - ETA: 0s - loss: 10.8336 - accuracy: 0.2138
26/40 [==================>...........] - ETA: 0s - loss: 10.7799 - accuracy: 0.2021
29/40 [====================>.........] - ETA: 0s - loss: 10.8697 - accuracy: 0.2145
32/40 [=======================>......] - ETA: 0s - loss: 11.2259 - accuracy: 0.2095
34/40 [========================>.....] - ETA: 0s - loss: 11.3873 - accuracy: 0.2079
36/40 [==========================>...] - ETA: 0s - loss: 11.5251 - accuracy: 0.2163
38/40 [===========================>..] - ETA: 0s - loss: 11.5483 - accuracy: 0.2114
40/40 [==============================] - 1s 25ms/step - loss: 11.7474 - accuracy: 0.2111

40/40 [==============================] - 1s 29ms/step - loss: 11.7474 - accuracy: 0.2111 - val_loss: 13.4094 - val_accuracy: 0.3540
Epoch 23/30

 1/40 [..............................] - ETA: 0s - loss: 14.6844 - accuracy: 0.3650
 3/40 [=>............................] - ETA: 0s - loss: 13.5829 - accuracy: 0.2050
 6/40 [===>..........................] - ETA: 0s - loss: 14.1963 - accuracy: 0.2450
 8/40 [=====>........................] - ETA: 0s - loss: 14.1146 - accuracy: 0.2700
10/40 [======>.......................] - ETA: 0s - loss: 13.9852 - accuracy: 0.2175
12/40 [========>.....................] - ETA: 0s - loss: 13.3919 - accuracy: 0.2129
14/40 [=========>....................] - ETA: 0s - loss: 12.7199 - accuracy: 0.2114
17/40 [===========>..................] - ETA: 0s - loss: 12.3331 - accuracy: 0.2103
19/40 [=============>................] - ETA: 0s - loss: 12.1419 - accuracy: 0.2084
22/40 [===============>..............] - ETA: 0s - loss: 12.1585 - accuracy: 0.2107
25/40 [=================>............] - ETA: 0s - loss: 11.9204 - accuracy: 0.2122
27/40 [===================>..........] - ETA: 0s - loss: 11.8054 - accuracy: 0.2215
29/40 [====================>.........] - ETA: 0s - loss: 12.1358 - accuracy: 0.2143
31/40 [======================>.......] - ETA: 0s - loss: 11.9871 - accuracy: 0.2118
34/40 [========================>.....] - ETA: 0s - loss: 12.0226 - accuracy: 0.2156
36/40 [==========================>...] - ETA: 0s - loss: 12.1208 - accuracy: 0.2186
38/40 [===========================>..] - ETA: 0s - loss: 12.1284 - accuracy: 0.2218
40/40 [==============================] - 1s 25ms/step - loss: 12.0922 - accuracy: 0.2250

40/40 [==============================] - 1s 30ms/step - loss: 12.0922 - accuracy: 0.2250 - val_loss: 10.4936 - val_accuracy: 0.2220
Epoch 24/30

 1/40 [..............................] - ETA: 0s - loss: 12.5867 - accuracy: 0.1950
 4/40 [==>...........................] - ETA: 0s - loss: 11.5389 - accuracy: 0.2075
 6/40 [===>..........................] - ETA: 0s - loss: 11.5522 - accuracy: 0.2275
 8/40 [=====>........................] - ETA: 0s - loss: 11.3888 - accuracy: 0.2456
11/40 [=======>......................] - ETA: 0s - loss: 10.9929 - accuracy: 0.2482
14/40 [=========>....................] - ETA: 0s - loss: 11.4001 - accuracy: 0.2489
16/40 [===========>..................] - ETA: 0s - loss: 11.4477 - accuracy: 0.2294
18/40 [============>.................] - ETA: 0s - loss: 10.9676 - accuracy: 0.2219
20/40 [==============>...............] - ETA: 0s - loss: 11.0632 - accuracy: 0.2288
22/40 [===============>..............] - ETA: 0s - loss: 10.9117 - accuracy: 0.2234
24/40 [=================>............] - ETA: 0s - loss: 11.1887 - accuracy: 0.2269
27/40 [===================>..........] - ETA: 0s - loss: 11.2681 - accuracy: 0.2304
29/40 [====================>.........] - ETA: 0s - loss: 11.3759 - accuracy: 0.2398
32/40 [=======================>......] - ETA: 0s - loss: 11.3232 - accuracy: 0.2467
34/40 [========================>.....] - ETA: 0s - loss: 11.3289 - accuracy: 0.2412
36/40 [==========================>...] - ETA: 0s - loss: 11.1453 - accuracy: 0.2463
38/40 [===========================>..] - ETA: 0s - loss: 11.0450 - accuracy: 0.2468
40/40 [==============================] - 1s 25ms/step - loss: 10.9661 - accuracy: 0.2534

40/40 [==============================] - 1s 30ms/step - loss: 10.9661 - accuracy: 0.2534 - val_loss: 9.0077 - val_accuracy: 0.3540
Epoch 25/30

 1/40 [..............................] - ETA: 0s - loss: 8.3450 - accuracy: 0.3200
 4/40 [==>...........................] - ETA: 0s - loss: 8.0909 - accuracy: 0.3438
 7/40 [====>.........................] - ETA: 0s - loss: 8.2198 - accuracy: 0.2757
 9/40 [=====>........................] - ETA: 0s - loss: 8.5320 - accuracy: 0.2539
11/40 [=======>......................] - ETA: 0s - loss: 9.5600 - accuracy: 0.2418
13/40 [========>.....................] - ETA: 0s - loss: 9.4893 - accuracy: 0.2427
15/40 [==========>...................] - ETA: 0s - loss: 9.6384 - accuracy: 0.2583
18/40 [============>.................] - ETA: 0s - loss: 9.9916 - accuracy: 0.2511
20/40 [==============>...............] - ETA: 0s - loss: 10.1855 - accuracy: 0.2278
22/40 [===============>..............] - ETA: 0s - loss: 10.1132 - accuracy: 0.2364
24/40 [=================>............] - ETA: 0s - loss: 10.1688 - accuracy: 0.2498
27/40 [===================>..........] - ETA: 0s - loss: 10.1224 - accuracy: 0.2398
29/40 [====================>.........] - ETA: 0s - loss: 10.2107 - accuracy: 0.2441
31/40 [======================>.......] - ETA: 0s - loss: 10.2512 - accuracy: 0.2505
33/40 [=======================>......] - ETA: 0s - loss: 10.1514 - accuracy: 0.2442
35/40 [=========================>....] - ETA: 0s - loss: 10.2081 - accuracy: 0.2376
37/40 [==========================>...] - ETA: 0s - loss: 10.1924 - accuracy: 0.2362
39/40 [============================>.] - ETA: 0s - loss: 10.1463 - accuracy: 0.2368
40/40 [==============================] - 1s 25ms/step - loss: 10.1620 - accuracy: 0.2384

40/40 [==============================] - 1s 30ms/step - loss: 10.1620 - accuracy: 0.2384 - val_loss: 10.4148 - val_accuracy: 0.3540
Epoch 26/30

 1/40 [..............................] - ETA: 0s - loss: 11.6297 - accuracy: 0.4150
 3/40 [=>............................] - ETA: 0s - loss: 11.1871 - accuracy: 0.2067
 5/40 [==>...........................] - ETA: 0s - loss: 11.5707 - accuracy: 0.2070
 7/40 [====>.........................] - ETA: 0s - loss: 11.0350 - accuracy: 0.2236
 9/40 [=====>........................] - ETA: 0s - loss: 11.0532 - accuracy: 0.2156
11/40 [=======>......................] - ETA: 0s - loss: 10.8212 - accuracy: 0.2309
13/40 [========>.....................] - ETA: 0s - loss: 10.5768 - accuracy: 0.2381
15/40 [==========>...................] - ETA: 0s - loss: 10.2002 - accuracy: 0.2347
17/40 [===========>..................] - ETA: 0s - loss: 10.1386 - accuracy: 0.2309
19/40 [=============>................] - ETA: 0s - loss: 9.9302 - accuracy: 0.2439 
21/40 [==============>...............] - ETA: 0s - loss: 9.6982 - accuracy: 0.2400
23/40 [================>.............] - ETA: 0s - loss: 9.5177 - accuracy: 0.2443
25/40 [=================>............] - ETA: 0s - loss: 9.4342 - accuracy: 0.2404
27/40 [===================>..........] - ETA: 0s - loss: 9.3834 - accuracy: 0.2385
29/40 [====================>.........] - ETA: 0s - loss: 9.4268 - accuracy: 0.2407
31/40 [======================>.......] - ETA: 0s - loss: 9.4916 - accuracy: 0.2440
33/40 [=======================>......] - ETA: 0s - loss: 9.4619 - accuracy: 0.2456
35/40 [=========================>....] - ETA: 0s - loss: 9.5761 - accuracy: 0.2470
37/40 [==========================>...] - ETA: 0s - loss: 9.5517 - accuracy: 0.2546
39/40 [============================>.] - ETA: 0s - loss: 9.6909 - accuracy: 0.2436
40/40 [==============================] - 1s 26ms/step - loss: 9.7410 - accuracy: 0.2448

40/40 [==============================] - 1s 32ms/step - loss: 9.7410 - accuracy: 0.2448 - val_loss: 10.3494 - val_accuracy: 0.2220
Epoch 27/30

 1/40 [..............................] - ETA: 0s - loss: 12.5291 - accuracy: 0.1750
 3/40 [=>............................] - ETA: 0s - loss: 10.5352 - accuracy: 0.1817
 5/40 [==>...........................] - ETA: 0s - loss: 9.7602 - accuracy: 0.1260 
 7/40 [====>.........................] - ETA: 0s - loss: 9.7984 - accuracy: 0.1471
 9/40 [=====>........................] - ETA: 0s - loss: 10.5737 - accuracy: 0.1661
11/40 [=======>......................] - ETA: 0s - loss: 10.6738 - accuracy: 0.1573
13/40 [========>.....................] - ETA: 0s - loss: 10.6531 - accuracy: 0.1685
15/40 [==========>...................] - ETA: 0s - loss: 10.8120 - accuracy: 0.1690
17/40 [===========>..................] - ETA: 0s - loss: 11.0178 - accuracy: 0.1624
19/40 [=============>................] - ETA: 0s - loss: 11.1270 - accuracy: 0.1816
21/40 [==============>...............] - ETA: 0s - loss: 11.3467 - accuracy: 0.1774
23/40 [================>.............] - ETA: 0s - loss: 11.2788 - accuracy: 0.1948
26/40 [==================>...........] - ETA: 0s - loss: 11.2838 - accuracy: 0.1912
28/40 [====================>.........] - ETA: 0s - loss: 11.3081 - accuracy: 0.1914
30/40 [=====================>........] - ETA: 0s - loss: 11.3295 - accuracy: 0.1868
32/40 [=======================>......] - ETA: 0s - loss: 11.4415 - accuracy: 0.1966
34/40 [========================>.....] - ETA: 0s - loss: 11.4476 - accuracy: 0.1982
36/40 [==========================>...] - ETA: 0s - loss: 11.5106 - accuracy: 0.1964
38/40 [===========================>..] - ETA: 0s - loss: 11.5008 - accuracy: 0.1938
40/40 [==============================] - 1s 25ms/step - loss: 11.4885 - accuracy: 0.2010

40/40 [==============================] - 1s 30ms/step - loss: 11.4885 - accuracy: 0.2010 - val_loss: 10.6435 - val_accuracy: 0.0440
Epoch 28/30

 1/40 [..............................] - ETA: 0s - loss: 13.1581 - accuracy: 0.0400
 4/40 [==>...........................] - ETA: 0s - loss: 11.5878 - accuracy: 0.2138
 7/40 [====>.........................] - ETA: 0s - loss: 11.7430 - accuracy: 0.1671
 9/40 [=====>........................] - ETA: 0s - loss: 11.7066 - accuracy: 0.2139
11/40 [=======>......................] - ETA: 0s - loss: 11.7003 - accuracy: 0.1941
13/40 [========>.....................] - ETA: 0s - loss: 11.7016 - accuracy: 0.2081
15/40 [==========>...................] - ETA: 0s - loss: 11.2966 - accuracy: 0.2063
17/40 [===========>..................] - ETA: 0s - loss: 10.9845 - accuracy: 0.2159
19/40 [=============>................] - ETA: 0s - loss: 10.6914 - accuracy: 0.2161
21/40 [==============>...............] - ETA: 0s - loss: 10.5847 - accuracy: 0.2231
23/40 [================>.............] - ETA: 0s - loss: 10.4406 - accuracy: 0.2285
25/40 [=================>............] - ETA: 0s - loss: 10.6057 - accuracy: 0.2140
27/40 [===================>..........] - ETA: 0s - loss: 10.5917 - accuracy: 0.2115
29/40 [====================>.........] - ETA: 0s - loss: 10.5348 - accuracy: 0.2090
32/40 [=======================>......] - ETA: 0s - loss: 10.4427 - accuracy: 0.2098
34/40 [========================>.....] - ETA: 0s - loss: 10.3431 - accuracy: 0.2185
36/40 [==========================>...] - ETA: 0s - loss: 10.1971 - accuracy: 0.2188
38/40 [===========================>..] - ETA: 0s - loss: 10.1897 - accuracy: 0.2247
40/40 [==============================] - 1s 25ms/step - loss: 10.1611 - accuracy: 0.2205

40/40 [==============================] - 1s 30ms/step - loss: 10.1611 - accuracy: 0.2205 - val_loss: 8.9120 - val_accuracy: 0.3540
Epoch 29/30

 1/40 [..............................] - ETA: 0s - loss: 7.6035 - accuracy: 0.3850
 4/40 [==>...........................] - ETA: 0s - loss: 8.9042 - accuracy: 0.2438
 6/40 [===>..........................] - ETA: 0s - loss: 8.5649 - accuracy: 0.2667
 8/40 [=====>........................] - ETA: 0s - loss: 8.4312 - accuracy: 0.2313
10/40 [======>.......................] - ETA: 0s - loss: 8.0859 - accuracy: 0.2200
12/40 [========>.....................] - ETA: 0s - loss: 8.0154 - accuracy: 0.2313
14/40 [=========>....................] - ETA: 0s - loss: 7.9909 - accuracy: 0.2218
17/40 [===========>..................] - ETA: 0s - loss: 8.1501 - accuracy: 0.1991
19/40 [=============>................] - ETA: 0s - loss: 8.0351 - accuracy: 0.1989
21/40 [==============>...............] - ETA: 0s - loss: 7.9853 - accuracy: 0.2033
23/40 [================>.............] - ETA: 0s - loss: 8.0946 - accuracy: 0.2120
25/40 [=================>............] - ETA: 0s - loss: 8.2033 - accuracy: 0.2080
28/40 [====================>.........] - ETA: 0s - loss: 8.2165 - accuracy: 0.2111
30/40 [=====================>........] - ETA: 0s - loss: 8.1666 - accuracy: 0.2155
32/40 [=======================>......] - ETA: 0s - loss: 8.2686 - accuracy: 0.2138
34/40 [========================>.....] - ETA: 0s - loss: 8.2996 - accuracy: 0.2134
36/40 [==========================>...] - ETA: 0s - loss: 8.3521 - accuracy: 0.2178
38/40 [===========================>..] - ETA: 0s - loss: 8.3771 - accuracy: 0.2216
40/40 [==============================] - 1s 25ms/step - loss: 8.3436 - accuracy: 0.2196

40/40 [==============================] - 1s 30ms/step - loss: 8.3436 - accuracy: 0.2196 - val_loss: 9.0137 - val_accuracy: 0.3540
Epoch 30/30

 1/40 [..............................] - ETA: 0s - loss: 11.0247 - accuracy: 0.2600
 4/40 [==>...........................] - ETA: 0s - loss: 10.4162 - accuracy: 0.1312
 7/40 [====>.........................] - ETA: 0s - loss: 9.9597 - accuracy: 0.1679 
 9/40 [=====>........................] - ETA: 0s - loss: 9.6997 - accuracy: 0.2139
11/40 [=======>......................] - ETA: 0s - loss: 9.4918 - accuracy: 0.2291
13/40 [========>.....................] - ETA: 0s - loss: 9.5618 - accuracy: 0.2231
15/40 [==========>...................] - ETA: 0s - loss: 9.3472 - accuracy: 0.2093
17/40 [===========>..................] - ETA: 0s - loss: 9.1486 - accuracy: 0.1885
19/40 [=============>................] - ETA: 0s - loss: 9.2312 - accuracy: 0.1913
21/40 [==============>...............] - ETA: 0s - loss: 9.3519 - accuracy: 0.2010
23/40 [================>.............] - ETA: 0s - loss: 9.6592 - accuracy: 0.1989
25/40 [=================>............] - ETA: 0s - loss: 9.8021 - accuracy: 0.1942
27/40 [===================>..........] - ETA: 0s - loss: 9.7863 - accuracy: 0.2080
29/40 [====================>.........] - ETA: 0s - loss: 9.9405 - accuracy: 0.2038
31/40 [======================>.......] - ETA: 0s - loss: 9.8944 - accuracy: 0.2081
33/40 [=======================>......] - ETA: 0s - loss: 9.8003 - accuracy: 0.2112
35/40 [=========================>....] - ETA: 0s - loss: 9.7405 - accuracy: 0.2126
37/40 [==========================>...] - ETA: 0s - loss: 9.6895 - accuracy: 0.2122
39/40 [============================>.] - ETA: 0s - loss: 9.7526 - accuracy: 0.2169
40/40 [==============================] - 1s 26ms/step - loss: 9.8711 - accuracy: 0.2185

40/40 [==============================] - 1s 30ms/step - loss: 9.8711 - accuracy: 0.2185 - val_loss: 11.4770 - val_accuracy: 0.2220

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-01T18-51-34Z

Training run 7/8 (flags = list(64, 1e-04, 200, 100, "relu")) 
Using run directory runs/2020-11-01T18-52-12Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = 10000) %>%
+         layer_dense( units = FLAGS$n .... [TRUNCATED] 

> set.seed(123)

> model %>% compile (
+         loss = 'sparse_categorical_crossentropy',
+         optimizer = optimizer_adam(lr=FLAGS$learning_rate),
+         metr .... [TRUNCATED] 

> model %>% fit (x = reuters_train, y = reuters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = list(reuters_val .... [TRUNCATED] 
Epoch 1/100

 1/40 [..............................] - ETA: 0s - loss: 3.8340 - accuracy: 0.0150
10/40 [======>.......................] - ETA: 0s - loss: 3.8261 - accuracy: 0.0115
19/40 [=============>................] - ETA: 0s - loss: 3.8142 - accuracy: 0.0192
27/40 [===================>..........] - ETA: 0s - loss: 3.8045 - accuracy: 0.0289
36/40 [==========================>...] - ETA: 0s - loss: 3.7916 - accuracy: 0.0454
40/40 [==============================] - 0s 6ms/step - loss: 3.7847 - accuracy: 0.0568

40/40 [==============================] - 1s 22ms/step - loss: 3.7847 - accuracy: 0.0568 - val_loss: 3.7143 - val_accuracy: 0.1730
Epoch 2/100

 1/40 [..............................] - ETA: 0s - loss: 3.7128 - accuracy: 0.1550
 9/40 [=====>........................] - ETA: 0s - loss: 3.6837 - accuracy: 0.2194
18/40 [============>.................] - ETA: 0s - loss: 3.6534 - accuracy: 0.2683
27/40 [===================>..........] - ETA: 0s - loss: 3.6162 - accuracy: 0.3093
35/40 [=========================>....] - ETA: 0s - loss: 3.5796 - accuracy: 0.3446
40/40 [==============================] - 0s 6ms/step - loss: 3.5538 - accuracy: 0.3628

40/40 [==============================] - 0s 10ms/step - loss: 3.5538 - accuracy: 0.3628 - val_loss: 3.3543 - val_accuracy: 0.5150
Epoch 3/100

 1/40 [..............................] - ETA: 0s - loss: 3.3510 - accuracy: 0.5150
10/40 [======>.......................] - ETA: 0s - loss: 3.2665 - accuracy: 0.5315
19/40 [=============>................] - ETA: 0s - loss: 3.2005 - accuracy: 0.5395
28/40 [====================>.........] - ETA: 0s - loss: 3.1378 - accuracy: 0.5380
37/40 [==========================>...] - ETA: 0s - loss: 3.0694 - accuracy: 0.5419
40/40 [==============================] - 0s 6ms/step - loss: 3.0470 - accuracy: 0.5427

40/40 [==============================] - 0s 10ms/step - loss: 3.0470 - accuracy: 0.5427 - val_loss: 2.7643 - val_accuracy: 0.5430
Epoch 4/100

 1/40 [..............................] - ETA: 0s - loss: 2.5719 - accuracy: 0.5750
11/40 [=======>......................] - ETA: 0s - loss: 2.5987 - accuracy: 0.5395
20/40 [==============>...............] - ETA: 0s - loss: 2.5458 - accuracy: 0.5425
30/40 [=====================>........] - ETA: 0s - loss: 2.4842 - accuracy: 0.5453
39/40 [============================>.] - ETA: 0s - loss: 2.4395 - accuracy: 0.5442
40/40 [==============================] - 0s 5ms/step - loss: 2.4351 - accuracy: 0.5441

40/40 [==============================] - 0s 9ms/step - loss: 2.4351 - accuracy: 0.5441 - val_loss: 2.2173 - val_accuracy: 0.5530
Epoch 5/100

 1/40 [..............................] - ETA: 0s - loss: 2.0562 - accuracy: 0.5900
11/40 [=======>......................] - ETA: 0s - loss: 2.0577 - accuracy: 0.5745
20/40 [==============>...............] - ETA: 0s - loss: 2.0374 - accuracy: 0.5750
29/40 [====================>.........] - ETA: 0s - loss: 1.9965 - accuracy: 0.5797
38/40 [===========================>..] - ETA: 0s - loss: 1.9693 - accuracy: 0.5821
40/40 [==============================] - 0s 5ms/step - loss: 1.9626 - accuracy: 0.5827

40/40 [==============================] - 0s 10ms/step - loss: 1.9626 - accuracy: 0.5827 - val_loss: 1.8674 - val_accuracy: 0.5860
Epoch 6/100

 1/40 [..............................] - ETA: 0s - loss: 1.8074 - accuracy: 0.5950
10/40 [======>.......................] - ETA: 0s - loss: 1.7199 - accuracy: 0.6205
19/40 [=============>................] - ETA: 0s - loss: 1.7420 - accuracy: 0.6132
28/40 [====================>.........] - ETA: 0s - loss: 1.7066 - accuracy: 0.6211
37/40 [==========================>...] - ETA: 0s - loss: 1.6813 - accuracy: 0.6251
40/40 [==============================] - 0s 6ms/step - loss: 1.6770 - accuracy: 0.6265

40/40 [==============================] - 0s 10ms/step - loss: 1.6770 - accuracy: 0.6265 - val_loss: 1.6611 - val_accuracy: 0.6150
Epoch 7/100

 1/40 [..............................] - ETA: 0s - loss: 1.4086 - accuracy: 0.6900
10/40 [======>.......................] - ETA: 0s - loss: 1.5614 - accuracy: 0.6530
19/40 [=============>................] - ETA: 0s - loss: 1.5389 - accuracy: 0.6626
28/40 [====================>.........] - ETA: 0s - loss: 1.5162 - accuracy: 0.6682
38/40 [===========================>..] - ETA: 0s - loss: 1.5007 - accuracy: 0.6716
40/40 [==============================] - 0s 6ms/step - loss: 1.4969 - accuracy: 0.6720

40/40 [==============================] - 0s 10ms/step - loss: 1.4969 - accuracy: 0.6720 - val_loss: 1.5316 - val_accuracy: 0.6590
Epoch 8/100

 1/40 [..............................] - ETA: 0s - loss: 1.3288 - accuracy: 0.7100
10/40 [======>.......................] - ETA: 0s - loss: 1.4346 - accuracy: 0.6930
20/40 [==============>...............] - ETA: 0s - loss: 1.3918 - accuracy: 0.6960
29/40 [====================>.........] - ETA: 0s - loss: 1.3869 - accuracy: 0.6964
38/40 [===========================>..] - ETA: 0s - loss: 1.3663 - accuracy: 0.6993
40/40 [==============================] - 0s 6ms/step - loss: 1.3676 - accuracy: 0.7001

40/40 [==============================] - 0s 9ms/step - loss: 1.3676 - accuracy: 0.7001 - val_loss: 1.4406 - val_accuracy: 0.6710
Epoch 9/100

 1/40 [..............................] - ETA: 0s - loss: 1.4008 - accuracy: 0.6800
 9/40 [=====>........................] - ETA: 0s - loss: 1.2832 - accuracy: 0.7139
18/40 [============>.................] - ETA: 0s - loss: 1.2753 - accuracy: 0.7175
27/40 [===================>..........] - ETA: 0s - loss: 1.2789 - accuracy: 0.7244
36/40 [==========================>...] - ETA: 0s - loss: 1.2608 - accuracy: 0.7249
40/40 [==============================] - 0s 6ms/step - loss: 1.2654 - accuracy: 0.7231

40/40 [==============================] - 0s 10ms/step - loss: 1.2654 - accuracy: 0.7231 - val_loss: 1.3714 - val_accuracy: 0.6910
Epoch 10/100

 1/40 [..............................] - ETA: 0s - loss: 1.1504 - accuracy: 0.7350
10/40 [======>.......................] - ETA: 0s - loss: 1.2234 - accuracy: 0.7270
19/40 [=============>................] - ETA: 0s - loss: 1.2240 - accuracy: 0.7305
28/40 [====================>.........] - ETA: 0s - loss: 1.1995 - accuracy: 0.7364
37/40 [==========================>...] - ETA: 0s - loss: 1.1878 - accuracy: 0.7403
40/40 [==============================] - 0s 6ms/step - loss: 1.1774 - accuracy: 0.7419

40/40 [==============================] - 0s 10ms/step - loss: 1.1774 - accuracy: 0.7419 - val_loss: 1.3121 - val_accuracy: 0.7080
Epoch 11/100

 1/40 [..............................] - ETA: 0s - loss: 1.2069 - accuracy: 0.7500
10/40 [======>.......................] - ETA: 0s - loss: 1.0865 - accuracy: 0.7665
19/40 [=============>................] - ETA: 0s - loss: 1.0785 - accuracy: 0.7671
28/40 [====================>.........] - ETA: 0s - loss: 1.0851 - accuracy: 0.7655
37/40 [==========================>...] - ETA: 0s - loss: 1.0936 - accuracy: 0.7618
40/40 [==============================] - 0s 6ms/step - loss: 1.0981 - accuracy: 0.7600

40/40 [==============================] - 0s 9ms/step - loss: 1.0981 - accuracy: 0.7600 - val_loss: 1.2611 - val_accuracy: 0.7210
Epoch 12/100

 1/40 [..............................] - ETA: 0s - loss: 1.1904 - accuracy: 0.7600
10/40 [======>.......................] - ETA: 0s - loss: 1.0197 - accuracy: 0.7820
19/40 [=============>................] - ETA: 0s - loss: 1.0012 - accuracy: 0.7845
28/40 [====================>.........] - ETA: 0s - loss: 1.0164 - accuracy: 0.7793
37/40 [==========================>...] - ETA: 0s - loss: 1.0214 - accuracy: 0.7786
40/40 [==============================] - 0s 6ms/step - loss: 1.0271 - accuracy: 0.7761

40/40 [==============================] - 0s 10ms/step - loss: 1.0271 - accuracy: 0.7761 - val_loss: 1.2165 - val_accuracy: 0.7430
Epoch 13/100

 1/40 [..............................] - ETA: 0s - loss: 1.0453 - accuracy: 0.7650
10/40 [======>.......................] - ETA: 0s - loss: 0.9630 - accuracy: 0.7975
19/40 [=============>................] - ETA: 0s - loss: 0.9687 - accuracy: 0.7934
28/40 [====================>.........] - ETA: 0s - loss: 0.9725 - accuracy: 0.7912
37/40 [==========================>...] - ETA: 0s - loss: 0.9712 - accuracy: 0.7903
40/40 [==============================] - 0s 6ms/step - loss: 0.9625 - accuracy: 0.7915

40/40 [==============================] - 0s 10ms/step - loss: 0.9625 - accuracy: 0.7915 - val_loss: 1.1776 - val_accuracy: 0.7470
Epoch 14/100

 1/40 [..............................] - ETA: 0s - loss: 0.7955 - accuracy: 0.8400
10/40 [======>.......................] - ETA: 0s - loss: 0.8705 - accuracy: 0.8115
18/40 [============>.................] - ETA: 0s - loss: 0.9196 - accuracy: 0.7992
27/40 [===================>..........] - ETA: 0s - loss: 0.9181 - accuracy: 0.8011
35/40 [=========================>....] - ETA: 0s - loss: 0.9113 - accuracy: 0.8009
40/40 [==============================] - 0s 6ms/step - loss: 0.9027 - accuracy: 0.8031

40/40 [==============================] - 0s 10ms/step - loss: 0.9027 - accuracy: 0.8031 - val_loss: 1.1474 - val_accuracy: 0.7550
Epoch 15/100

 1/40 [..............................] - ETA: 0s - loss: 0.9945 - accuracy: 0.7800
10/40 [======>.......................] - ETA: 0s - loss: 0.8270 - accuracy: 0.8105
18/40 [============>.................] - ETA: 0s - loss: 0.8535 - accuracy: 0.8056
27/40 [===================>..........] - ETA: 0s - loss: 0.8495 - accuracy: 0.8115
35/40 [=========================>....] - ETA: 0s - loss: 0.8475 - accuracy: 0.8126
40/40 [==============================] - 0s 6ms/step - loss: 0.8479 - accuracy: 0.8142

40/40 [==============================] - 0s 10ms/step - loss: 0.8479 - accuracy: 0.8142 - val_loss: 1.1196 - val_accuracy: 0.7610
Epoch 16/100

 1/40 [..............................] - ETA: 0s - loss: 0.8263 - accuracy: 0.8100
10/40 [======>.......................] - ETA: 0s - loss: 0.8356 - accuracy: 0.8140
18/40 [============>.................] - ETA: 0s - loss: 0.8315 - accuracy: 0.8161
26/40 [==================>...........] - ETA: 0s - loss: 0.8145 - accuracy: 0.8219
35/40 [=========================>....] - ETA: 0s - loss: 0.8002 - accuracy: 0.8223
40/40 [==============================] - 0s 6ms/step - loss: 0.7965 - accuracy: 0.8236

40/40 [==============================] - 0s 10ms/step - loss: 0.7965 - accuracy: 0.8236 - val_loss: 1.0951 - val_accuracy: 0.7690
Epoch 17/100

 1/40 [..............................] - ETA: 0s - loss: 0.8042 - accuracy: 0.8100
10/40 [======>.......................] - ETA: 0s - loss: 0.7295 - accuracy: 0.8385
20/40 [==============>...............] - ETA: 0s - loss: 0.7660 - accuracy: 0.8270
28/40 [====================>.........] - ETA: 0s - loss: 0.7643 - accuracy: 0.8279
37/40 [==========================>...] - ETA: 0s - loss: 0.7502 - accuracy: 0.8324
40/40 [==============================] - 0s 6ms/step - loss: 0.7486 - accuracy: 0.8326

40/40 [==============================] - 0s 10ms/step - loss: 0.7486 - accuracy: 0.8326 - val_loss: 1.0721 - val_accuracy: 0.7740
Epoch 18/100

 1/40 [..............................] - ETA: 0s - loss: 0.6908 - accuracy: 0.8500
10/40 [======>.......................] - ETA: 0s - loss: 0.7036 - accuracy: 0.8480
19/40 [=============>................] - ETA: 0s - loss: 0.7162 - accuracy: 0.8387
28/40 [====================>.........] - ETA: 0s - loss: 0.7161 - accuracy: 0.8389
37/40 [==========================>...] - ETA: 0s - loss: 0.7004 - accuracy: 0.8438
40/40 [==============================] - 0s 6ms/step - loss: 0.7023 - accuracy: 0.8435

40/40 [==============================] - 0s 10ms/step - loss: 0.7023 - accuracy: 0.8435 - val_loss: 1.0543 - val_accuracy: 0.7800
Epoch 19/100

 1/40 [..............................] - ETA: 0s - loss: 0.6630 - accuracy: 0.8200
10/40 [======>.......................] - ETA: 0s - loss: 0.6543 - accuracy: 0.8565
19/40 [=============>................] - ETA: 0s - loss: 0.6491 - accuracy: 0.8542
28/40 [====================>.........] - ETA: 0s - loss: 0.6524 - accuracy: 0.8543
38/40 [===========================>..] - ETA: 0s - loss: 0.6589 - accuracy: 0.8545
40/40 [==============================] - 0s 6ms/step - loss: 0.6603 - accuracy: 0.8538

40/40 [==============================] - 0s 9ms/step - loss: 0.6603 - accuracy: 0.8538 - val_loss: 1.0382 - val_accuracy: 0.7770
Epoch 20/100

 1/40 [..............................] - ETA: 0s - loss: 0.5438 - accuracy: 0.8900
10/40 [======>.......................] - ETA: 0s - loss: 0.6227 - accuracy: 0.8640
20/40 [==============>...............] - ETA: 0s - loss: 0.6325 - accuracy: 0.8577
29/40 [====================>.........] - ETA: 0s - loss: 0.6304 - accuracy: 0.8574
38/40 [===========================>..] - ETA: 0s - loss: 0.6256 - accuracy: 0.8592
40/40 [==============================] - 0s 6ms/step - loss: 0.6208 - accuracy: 0.8606

40/40 [==============================] - 0s 9ms/step - loss: 0.6208 - accuracy: 0.8606 - val_loss: 1.0233 - val_accuracy: 0.7770
Epoch 21/100

 1/40 [..............................] - ETA: 0s - loss: 0.6792 - accuracy: 0.8350
10/40 [======>.......................] - ETA: 0s - loss: 0.6008 - accuracy: 0.8725
19/40 [=============>................] - ETA: 0s - loss: 0.5983 - accuracy: 0.8663
28/40 [====================>.........] - ETA: 0s - loss: 0.5883 - accuracy: 0.8705
36/40 [==========================>...] - ETA: 0s - loss: 0.5914 - accuracy: 0.8706
40/40 [==============================] - 0s 6ms/step - loss: 0.5835 - accuracy: 0.8717

40/40 [==============================] - 0s 10ms/step - loss: 0.5835 - accuracy: 0.8717 - val_loss: 1.0102 - val_accuracy: 0.7920
Epoch 22/100

 1/40 [..............................] - ETA: 0s - loss: 0.5250 - accuracy: 0.8850
 9/40 [=====>........................] - ETA: 0s - loss: 0.5489 - accuracy: 0.8722
18/40 [============>.................] - ETA: 0s - loss: 0.5338 - accuracy: 0.8792
26/40 [==================>...........] - ETA: 0s - loss: 0.5456 - accuracy: 0.8779
34/40 [========================>.....] - ETA: 0s - loss: 0.5440 - accuracy: 0.8800
40/40 [==============================] - 0s 6ms/step - loss: 0.5481 - accuracy: 0.8781

40/40 [==============================] - 0s 10ms/step - loss: 0.5481 - accuracy: 0.8781 - val_loss: 0.9995 - val_accuracy: 0.7950
Epoch 23/100

 1/40 [..............................] - ETA: 0s - loss: 0.5192 - accuracy: 0.8750
10/40 [======>.......................] - ETA: 0s - loss: 0.5470 - accuracy: 0.8760
19/40 [=============>................] - ETA: 0s - loss: 0.5342 - accuracy: 0.8805
28/40 [====================>.........] - ETA: 0s - loss: 0.5298 - accuracy: 0.8825
35/40 [=========================>....] - ETA: 0s - loss: 0.5104 - accuracy: 0.8874
40/40 [==============================] - 0s 6ms/step - loss: 0.5154 - accuracy: 0.8852

40/40 [==============================] - 0s 10ms/step - loss: 0.5154 - accuracy: 0.8852 - val_loss: 0.9889 - val_accuracy: 0.7970
Epoch 24/100

 1/40 [..............................] - ETA: 0s - loss: 0.5118 - accuracy: 0.8950
10/40 [======>.......................] - ETA: 0s - loss: 0.4836 - accuracy: 0.8905
19/40 [=============>................] - ETA: 0s - loss: 0.4990 - accuracy: 0.8858
28/40 [====================>.........] - ETA: 0s - loss: 0.5011 - accuracy: 0.8852
38/40 [===========================>..] - ETA: 0s - loss: 0.4846 - accuracy: 0.8900
40/40 [==============================] - 0s 6ms/step - loss: 0.4857 - accuracy: 0.8898

40/40 [==============================] - 0s 9ms/step - loss: 0.4857 - accuracy: 0.8898 - val_loss: 0.9824 - val_accuracy: 0.7990
Epoch 25/100

 1/40 [..............................] - ETA: 0s - loss: 0.3394 - accuracy: 0.9300
10/40 [======>.......................] - ETA: 0s - loss: 0.4459 - accuracy: 0.8965
19/40 [=============>................] - ETA: 0s - loss: 0.4569 - accuracy: 0.8921
28/40 [====================>.........] - ETA: 0s - loss: 0.4529 - accuracy: 0.8961
37/40 [==========================>...] - ETA: 0s - loss: 0.4555 - accuracy: 0.8959
40/40 [==============================] - 0s 6ms/step - loss: 0.4564 - accuracy: 0.8955

40/40 [==============================] - 0s 10ms/step - loss: 0.4564 - accuracy: 0.8955 - val_loss: 0.9766 - val_accuracy: 0.7950
Epoch 26/100

 1/40 [..............................] - ETA: 0s - loss: 0.4537 - accuracy: 0.8850
10/40 [======>.......................] - ETA: 0s - loss: 0.4042 - accuracy: 0.9080
19/40 [=============>................] - ETA: 0s - loss: 0.4430 - accuracy: 0.9013
28/40 [====================>.........] - ETA: 0s - loss: 0.4353 - accuracy: 0.9021
37/40 [==========================>...] - ETA: 0s - loss: 0.4317 - accuracy: 0.9031
40/40 [==============================] - 0s 6ms/step - loss: 0.4300 - accuracy: 0.9029

40/40 [==============================] - 0s 10ms/step - loss: 0.4300 - accuracy: 0.9029 - val_loss: 0.9740 - val_accuracy: 0.8020
Epoch 27/100

 1/40 [..............................] - ETA: 0s - loss: 0.3933 - accuracy: 0.9250
10/40 [======>.......................] - ETA: 0s - loss: 0.4029 - accuracy: 0.9075
19/40 [=============>................] - ETA: 0s - loss: 0.3960 - accuracy: 0.9105
28/40 [====================>.........] - ETA: 0s - loss: 0.3969 - accuracy: 0.9093
37/40 [==========================>...] - ETA: 0s - loss: 0.4034 - accuracy: 0.9076
40/40 [==============================] - 0s 6ms/step - loss: 0.4049 - accuracy: 0.9068

40/40 [==============================] - 0s 10ms/step - loss: 0.4049 - accuracy: 0.9068 - val_loss: 0.9686 - val_accuracy: 0.8080
Epoch 28/100

 1/40 [..............................] - ETA: 0s - loss: 0.3093 - accuracy: 0.9450
10/40 [======>.......................] - ETA: 0s - loss: 0.3813 - accuracy: 0.9095
19/40 [=============>................] - ETA: 0s - loss: 0.3975 - accuracy: 0.9097
28/40 [====================>.........] - ETA: 0s - loss: 0.3826 - accuracy: 0.9132
37/40 [==========================>...] - ETA: 0s - loss: 0.3840 - accuracy: 0.9107
40/40 [==============================] - 0s 6ms/step - loss: 0.3815 - accuracy: 0.9114

40/40 [==============================] - 0s 10ms/step - loss: 0.3815 - accuracy: 0.9114 - val_loss: 0.9653 - val_accuracy: 0.8080
Epoch 29/100

 1/40 [..............................] - ETA: 0s - loss: 0.3258 - accuracy: 0.9200
11/40 [=======>......................] - ETA: 0s - loss: 0.3542 - accuracy: 0.9177
20/40 [==============>...............] - ETA: 0s - loss: 0.3565 - accuracy: 0.9175
29/40 [====================>.........] - ETA: 0s - loss: 0.3500 - accuracy: 0.9174
38/40 [===========================>..] - ETA: 0s - loss: 0.3597 - accuracy: 0.9161
40/40 [==============================] - 0s 6ms/step - loss: 0.3595 - accuracy: 0.9161

40/40 [==============================] - 0s 9ms/step - loss: 0.3595 - accuracy: 0.9161 - val_loss: 0.9644 - val_accuracy: 0.8070
Epoch 30/100

 1/40 [..............................] - ETA: 0s - loss: 0.3172 - accuracy: 0.9200
10/40 [======>.......................] - ETA: 0s - loss: 0.3510 - accuracy: 0.9235
19/40 [=============>................] - ETA: 0s - loss: 0.3383 - accuracy: 0.9232
28/40 [====================>.........] - ETA: 0s - loss: 0.3392 - accuracy: 0.9239
37/40 [==========================>...] - ETA: 0s - loss: 0.3401 - accuracy: 0.9230
40/40 [==============================] - 0s 6ms/step - loss: 0.3395 - accuracy: 0.9228

40/40 [==============================] - 0s 10ms/step - loss: 0.3395 - accuracy: 0.9228 - val_loss: 0.9622 - val_accuracy: 0.8130
Epoch 31/100

 1/40 [..............................] - ETA: 0s - loss: 0.3199 - accuracy: 0.9350
 9/40 [=====>........................] - ETA: 0s - loss: 0.3080 - accuracy: 0.9394
19/40 [=============>................] - ETA: 0s - loss: 0.3243 - accuracy: 0.9297
28/40 [====================>.........] - ETA: 0s - loss: 0.3243 - accuracy: 0.9277
37/40 [==========================>...] - ETA: 0s - loss: 0.3220 - accuracy: 0.9280
40/40 [==============================] - 0s 6ms/step - loss: 0.3206 - accuracy: 0.9282

40/40 [==============================] - 0s 9ms/step - loss: 0.3206 - accuracy: 0.9282 - val_loss: 0.9671 - val_accuracy: 0.8030
Epoch 32/100

 1/40 [..............................] - ETA: 0s - loss: 0.2569 - accuracy: 0.9550
10/40 [======>.......................] - ETA: 0s - loss: 0.2847 - accuracy: 0.9350
18/40 [============>.................] - ETA: 0s - loss: 0.2869 - accuracy: 0.9342
27/40 [===================>..........] - ETA: 0s - loss: 0.2924 - accuracy: 0.9348
36/40 [==========================>...] - ETA: 0s - loss: 0.3003 - accuracy: 0.9318
40/40 [==============================] - 0s 6ms/step - loss: 0.3031 - accuracy: 0.9306

40/40 [==============================] - 0s 10ms/step - loss: 0.3031 - accuracy: 0.9306 - val_loss: 0.9644 - val_accuracy: 0.8100
Epoch 33/100

 1/40 [..............................] - ETA: 0s - loss: 0.2637 - accuracy: 0.9450
10/40 [======>.......................] - ETA: 0s - loss: 0.2945 - accuracy: 0.9285
20/40 [==============>...............] - ETA: 0s - loss: 0.2905 - accuracy: 0.9342
29/40 [====================>.........] - ETA: 0s - loss: 0.2845 - accuracy: 0.9357
38/40 [===========================>..] - ETA: 0s - loss: 0.2885 - accuracy: 0.9333
40/40 [==============================] - 0s 6ms/step - loss: 0.2893 - accuracy: 0.9327

40/40 [==============================] - 0s 9ms/step - loss: 0.2893 - accuracy: 0.9327 - val_loss: 0.9693 - val_accuracy: 0.8090
Epoch 34/100

 1/40 [..............................] - ETA: 0s - loss: 0.3284 - accuracy: 0.9300
11/40 [=======>......................] - ETA: 0s - loss: 0.2865 - accuracy: 0.9395
21/40 [==============>...............] - ETA: 0s - loss: 0.2826 - accuracy: 0.9364
30/40 [=====================>........] - ETA: 0s - loss: 0.2789 - accuracy: 0.9358
39/40 [============================>.] - ETA: 0s - loss: 0.2729 - accuracy: 0.9365
40/40 [==============================] - 0s 6ms/step - loss: 0.2739 - accuracy: 0.9357

40/40 [==============================] - 0s 9ms/step - loss: 0.2739 - accuracy: 0.9357 - val_loss: 0.9673 - val_accuracy: 0.8060
Epoch 35/100

 1/40 [..............................] - ETA: 0s - loss: 0.2184 - accuracy: 0.9450
10/40 [======>.......................] - ETA: 0s - loss: 0.2578 - accuracy: 0.9345
19/40 [=============>................] - ETA: 0s - loss: 0.2527 - accuracy: 0.9379
29/40 [====================>.........] - ETA: 0s - loss: 0.2548 - accuracy: 0.9395
38/40 [===========================>..] - ETA: 0s - loss: 0.2606 - accuracy: 0.9391
40/40 [==============================] - 0s 6ms/step - loss: 0.2595 - accuracy: 0.9391

40/40 [==============================] - 0s 10ms/step - loss: 0.2595 - accuracy: 0.9391 - val_loss: 0.9690 - val_accuracy: 0.8100
Epoch 36/100

 1/40 [..............................] - ETA: 0s - loss: 0.1994 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.2400 - accuracy: 0.9470
19/40 [=============>................] - ETA: 0s - loss: 0.2399 - accuracy: 0.9476
28/40 [====================>.........] - ETA: 0s - loss: 0.2400 - accuracy: 0.9463
37/40 [==========================>...] - ETA: 0s - loss: 0.2432 - accuracy: 0.9428
40/40 [==============================] - 0s 6ms/step - loss: 0.2473 - accuracy: 0.9416

40/40 [==============================] - 0s 10ms/step - loss: 0.2473 - accuracy: 0.9416 - val_loss: 0.9717 - val_accuracy: 0.8130
Epoch 37/100

 1/40 [..............................] - ETA: 0s - loss: 0.2306 - accuracy: 0.9400
10/40 [======>.......................] - ETA: 0s - loss: 0.2277 - accuracy: 0.9470
19/40 [=============>................] - ETA: 0s - loss: 0.2295 - accuracy: 0.9471
28/40 [====================>.........] - ETA: 0s - loss: 0.2262 - accuracy: 0.9475
37/40 [==========================>...] - ETA: 0s - loss: 0.2359 - accuracy: 0.9432
40/40 [==============================] - 0s 6ms/step - loss: 0.2358 - accuracy: 0.9436

40/40 [==============================] - 0s 10ms/step - loss: 0.2358 - accuracy: 0.9436 - val_loss: 0.9758 - val_accuracy: 0.8140
Epoch 38/100

 1/40 [..............................] - ETA: 0s - loss: 0.2060 - accuracy: 0.9550
10/40 [======>.......................] - ETA: 0s - loss: 0.2104 - accuracy: 0.9515
19/40 [=============>................] - ETA: 0s - loss: 0.2155 - accuracy: 0.9482
29/40 [====================>.........] - ETA: 0s - loss: 0.2274 - accuracy: 0.9447
38/40 [===========================>..] - ETA: 0s - loss: 0.2244 - accuracy: 0.9464
40/40 [==============================] - 0s 6ms/step - loss: 0.2241 - accuracy: 0.9464

40/40 [==============================] - 0s 10ms/step - loss: 0.2241 - accuracy: 0.9464 - val_loss: 0.9875 - val_accuracy: 0.8050
Epoch 39/100

 1/40 [..............................] - ETA: 0s - loss: 0.2081 - accuracy: 0.9400
10/40 [======>.......................] - ETA: 0s - loss: 0.2100 - accuracy: 0.9440
19/40 [=============>................] - ETA: 0s - loss: 0.2056 - accuracy: 0.9468
28/40 [====================>.........] - ETA: 0s - loss: 0.2074 - accuracy: 0.9482
37/40 [==========================>...] - ETA: 0s - loss: 0.2131 - accuracy: 0.9485
40/40 [==============================] - 0s 6ms/step - loss: 0.2137 - accuracy: 0.9480

40/40 [==============================] - 0s 10ms/step - loss: 0.2137 - accuracy: 0.9480 - val_loss: 0.9908 - val_accuracy: 0.8110
Epoch 40/100

 1/40 [..............................] - ETA: 0s - loss: 0.1869 - accuracy: 0.9650
 9/40 [=====>........................] - ETA: 0s - loss: 0.2020 - accuracy: 0.9483
18/40 [============>.................] - ETA: 0s - loss: 0.1987 - accuracy: 0.9503
26/40 [==================>...........] - ETA: 0s - loss: 0.2062 - accuracy: 0.9481
35/40 [=========================>....] - ETA: 0s - loss: 0.2064 - accuracy: 0.9477
40/40 [==============================] - 0s 6ms/step - loss: 0.2056 - accuracy: 0.9489

40/40 [==============================] - 0s 10ms/step - loss: 0.2056 - accuracy: 0.9489 - val_loss: 0.9847 - val_accuracy: 0.8110
Epoch 41/100

 1/40 [..............................] - ETA: 0s - loss: 0.2206 - accuracy: 0.9550
10/40 [======>.......................] - ETA: 0s - loss: 0.2101 - accuracy: 0.9515
19/40 [=============>................] - ETA: 0s - loss: 0.1971 - accuracy: 0.9539
29/40 [====================>.........] - ETA: 0s - loss: 0.1928 - accuracy: 0.9529
38/40 [===========================>..] - ETA: 0s - loss: 0.1957 - accuracy: 0.9512
40/40 [==============================] - 0s 6ms/step - loss: 0.1962 - accuracy: 0.9514

40/40 [==============================] - 0s 10ms/step - loss: 0.1962 - accuracy: 0.9514 - val_loss: 0.9952 - val_accuracy: 0.8060
Epoch 42/100

 1/40 [..............................] - ETA: 0s - loss: 0.1649 - accuracy: 0.9650
10/40 [======>.......................] - ETA: 0s - loss: 0.1787 - accuracy: 0.9555
19/40 [=============>................] - ETA: 0s - loss: 0.1746 - accuracy: 0.9558
28/40 [====================>.........] - ETA: 0s - loss: 0.1800 - accuracy: 0.9548
38/40 [===========================>..] - ETA: 0s - loss: 0.1884 - accuracy: 0.9503
40/40 [==============================] - 0s 6ms/step - loss: 0.1886 - accuracy: 0.9499

40/40 [==============================] - 0s 9ms/step - loss: 0.1886 - accuracy: 0.9499 - val_loss: 0.9990 - val_accuracy: 0.8110
Epoch 43/100

 1/40 [..............................] - ETA: 0s - loss: 0.1512 - accuracy: 0.9750
10/40 [======>.......................] - ETA: 0s - loss: 0.1825 - accuracy: 0.9530
19/40 [=============>................] - ETA: 0s - loss: 0.1789 - accuracy: 0.9542
28/40 [====================>.........] - ETA: 0s - loss: 0.1848 - accuracy: 0.9516
37/40 [==========================>...] - ETA: 0s - loss: 0.1813 - accuracy: 0.9516
40/40 [==============================] - 0s 6ms/step - loss: 0.1814 - accuracy: 0.9515

40/40 [==============================] - 0s 10ms/step - loss: 0.1814 - accuracy: 0.9515 - val_loss: 1.0012 - val_accuracy: 0.8080
Epoch 44/100

 1/40 [..............................] - ETA: 0s - loss: 0.1568 - accuracy: 0.9650
10/40 [======>.......................] - ETA: 0s - loss: 0.1710 - accuracy: 0.9505
19/40 [=============>................] - ETA: 0s - loss: 0.1710 - accuracy: 0.9521
28/40 [====================>.........] - ETA: 0s - loss: 0.1705 - accuracy: 0.9529
37/40 [==========================>...] - ETA: 0s - loss: 0.1751 - accuracy: 0.9520
40/40 [==============================] - 0s 6ms/step - loss: 0.1748 - accuracy: 0.9521

40/40 [==============================] - 0s 10ms/step - loss: 0.1748 - accuracy: 0.9521 - val_loss: 1.0052 - val_accuracy: 0.8130
Epoch 45/100

 1/40 [..............................] - ETA: 0s - loss: 0.1733 - accuracy: 0.9750
10/40 [======>.......................] - ETA: 0s - loss: 0.1838 - accuracy: 0.9530
19/40 [=============>................] - ETA: 0s - loss: 0.1778 - accuracy: 0.9542
27/40 [===================>..........] - ETA: 0s - loss: 0.1717 - accuracy: 0.9535
36/40 [==========================>...] - ETA: 0s - loss: 0.1687 - accuracy: 0.9538
40/40 [==============================] - 0s 6ms/step - loss: 0.1684 - accuracy: 0.9540

40/40 [==============================] - 0s 10ms/step - loss: 0.1684 - accuracy: 0.9540 - val_loss: 1.0171 - val_accuracy: 0.8070
Epoch 46/100

 1/40 [..............................] - ETA: 0s - loss: 0.1397 - accuracy: 0.9600
10/40 [======>.......................] - ETA: 0s - loss: 0.1419 - accuracy: 0.9635
19/40 [=============>................] - ETA: 0s - loss: 0.1576 - accuracy: 0.9605
28/40 [====================>.........] - ETA: 0s - loss: 0.1645 - accuracy: 0.9570
37/40 [==========================>...] - ETA: 0s - loss: 0.1625 - accuracy: 0.9555
40/40 [==============================] - 0s 6ms/step - loss: 0.1623 - accuracy: 0.9550

40/40 [==============================] - 0s 10ms/step - loss: 0.1623 - accuracy: 0.9550 - val_loss: 1.0201 - val_accuracy: 0.8070
Epoch 47/100

 1/40 [..............................] - ETA: 0s - loss: 0.1421 - accuracy: 0.9450
10/40 [======>.......................] - ETA: 0s - loss: 0.1452 - accuracy: 0.9630
19/40 [=============>................] - ETA: 0s - loss: 0.1479 - accuracy: 0.9613
29/40 [====================>.........] - ETA: 0s - loss: 0.1544 - accuracy: 0.9572
38/40 [===========================>..] - ETA: 0s - loss: 0.1553 - accuracy: 0.9559
40/40 [==============================] - 0s 6ms/step - loss: 0.1567 - accuracy: 0.9557

40/40 [==============================] - 0s 9ms/step - loss: 0.1567 - accuracy: 0.9557 - val_loss: 1.0187 - val_accuracy: 0.8050
Epoch 48/100

 1/40 [..............................] - ETA: 0s - loss: 0.1278 - accuracy: 0.9650
11/40 [=======>......................] - ETA: 0s - loss: 0.1476 - accuracy: 0.9627
20/40 [==============>...............] - ETA: 0s - loss: 0.1491 - accuracy: 0.9625
30/40 [=====================>........] - ETA: 0s - loss: 0.1527 - accuracy: 0.9583
39/40 [============================>.] - ETA: 0s - loss: 0.1524 - accuracy: 0.9567
40/40 [==============================] - 0s 6ms/step - loss: 0.1515 - accuracy: 0.9569

40/40 [==============================] - 0s 9ms/step - loss: 0.1515 - accuracy: 0.9569 - val_loss: 1.0219 - val_accuracy: 0.8080
Epoch 49/100

 1/40 [..............................] - ETA: 0s - loss: 0.1811 - accuracy: 0.9550
10/40 [======>.......................] - ETA: 0s - loss: 0.1483 - accuracy: 0.9600
19/40 [=============>................] - ETA: 0s - loss: 0.1443 - accuracy: 0.9571
27/40 [===================>..........] - ETA: 0s - loss: 0.1477 - accuracy: 0.9561
35/40 [=========================>....] - ETA: 0s - loss: 0.1492 - accuracy: 0.9564
40/40 [==============================] - 0s 6ms/step - loss: 0.1463 - accuracy: 0.9569

40/40 [==============================] - 0s 10ms/step - loss: 0.1463 - accuracy: 0.9569 - val_loss: 1.0380 - val_accuracy: 0.8070
Epoch 50/100

 1/40 [..............................] - ETA: 0s - loss: 0.1196 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.1368 - accuracy: 0.9645
19/40 [=============>................] - ETA: 0s - loss: 0.1427 - accuracy: 0.9611
28/40 [====================>.........] - ETA: 0s - loss: 0.1430 - accuracy: 0.9584
37/40 [==========================>...] - ETA: 0s - loss: 0.1409 - accuracy: 0.9580
40/40 [==============================] - 0s 6ms/step - loss: 0.1416 - accuracy: 0.9577

40/40 [==============================] - 0s 10ms/step - loss: 0.1416 - accuracy: 0.9577 - val_loss: 1.0343 - val_accuracy: 0.8140
Epoch 51/100

 1/40 [..............................] - ETA: 0s - loss: 0.0930 - accuracy: 0.9850
10/40 [======>.......................] - ETA: 0s - loss: 0.1250 - accuracy: 0.9655
19/40 [=============>................] - ETA: 0s - loss: 0.1325 - accuracy: 0.9647
29/40 [====================>.........] - ETA: 0s - loss: 0.1363 - accuracy: 0.9602
38/40 [===========================>..] - ETA: 0s - loss: 0.1380 - accuracy: 0.9587
40/40 [==============================] - 0s 6ms/step - loss: 0.1374 - accuracy: 0.9583

40/40 [==============================] - 0s 10ms/step - loss: 0.1374 - accuracy: 0.9583 - val_loss: 1.0435 - val_accuracy: 0.8110
Epoch 52/100

 1/40 [..............................] - ETA: 0s - loss: 0.1131 - accuracy: 0.9500
10/40 [======>.......................] - ETA: 0s - loss: 0.1326 - accuracy: 0.9590
19/40 [=============>................] - ETA: 0s - loss: 0.1274 - accuracy: 0.9616
28/40 [====================>.........] - ETA: 0s - loss: 0.1296 - accuracy: 0.9582
37/40 [==========================>...] - ETA: 0s - loss: 0.1339 - accuracy: 0.9574
40/40 [==============================] - 0s 6ms/step - loss: 0.1345 - accuracy: 0.9567

40/40 [==============================] - 0s 10ms/step - loss: 0.1345 - accuracy: 0.9567 - val_loss: 1.0425 - val_accuracy: 0.8120
Epoch 53/100

 1/40 [..............................] - ETA: 0s - loss: 0.1499 - accuracy: 0.9600
10/40 [======>.......................] - ETA: 0s - loss: 0.1109 - accuracy: 0.9695
20/40 [==============>...............] - ETA: 0s - loss: 0.1237 - accuracy: 0.9622
29/40 [====================>.........] - ETA: 0s - loss: 0.1272 - accuracy: 0.9610
38/40 [===========================>..] - ETA: 0s - loss: 0.1304 - accuracy: 0.9595
40/40 [==============================] - 0s 6ms/step - loss: 0.1298 - accuracy: 0.9600

40/40 [==============================] - 0s 9ms/step - loss: 0.1298 - accuracy: 0.9600 - val_loss: 1.0508 - val_accuracy: 0.8120
Epoch 54/100

 1/40 [..............................] - ETA: 0s - loss: 0.0782 - accuracy: 0.9850
10/40 [======>.......................] - ETA: 0s - loss: 0.1348 - accuracy: 0.9640
19/40 [=============>................] - ETA: 0s - loss: 0.1300 - accuracy: 0.9611
28/40 [====================>.........] - ETA: 0s - loss: 0.1277 - accuracy: 0.9609
37/40 [==========================>...] - ETA: 0s - loss: 0.1271 - accuracy: 0.9597
40/40 [==============================] - 0s 6ms/step - loss: 0.1267 - accuracy: 0.9597

40/40 [==============================] - 0s 9ms/step - loss: 0.1267 - accuracy: 0.9597 - val_loss: 1.0620 - val_accuracy: 0.8070
Epoch 55/100

 1/40 [..............................] - ETA: 0s - loss: 0.0731 - accuracy: 0.9750
10/40 [======>.......................] - ETA: 0s - loss: 0.1185 - accuracy: 0.9645
19/40 [=============>................] - ETA: 0s - loss: 0.1153 - accuracy: 0.9639
28/40 [====================>.........] - ETA: 0s - loss: 0.1181 - accuracy: 0.9629
36/40 [==========================>...] - ETA: 0s - loss: 0.1222 - accuracy: 0.9590
40/40 [==============================] - 0s 6ms/step - loss: 0.1234 - accuracy: 0.9587

40/40 [==============================] - 0s 10ms/step - loss: 0.1234 - accuracy: 0.9587 - val_loss: 1.0533 - val_accuracy: 0.8080
Epoch 56/100

 1/40 [..............................] - ETA: 0s - loss: 0.0967 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.1125 - accuracy: 0.9670
19/40 [=============>................] - ETA: 0s - loss: 0.1174 - accuracy: 0.9629
28/40 [====================>.........] - ETA: 0s - loss: 0.1206 - accuracy: 0.9613
37/40 [==========================>...] - ETA: 0s - loss: 0.1213 - accuracy: 0.9607
40/40 [==============================] - 0s 6ms/step - loss: 0.1215 - accuracy: 0.9589

40/40 [==============================] - 0s 9ms/step - loss: 0.1215 - accuracy: 0.9589 - val_loss: 1.0671 - val_accuracy: 0.8090
Epoch 57/100

 1/40 [..............................] - ETA: 0s - loss: 0.1269 - accuracy: 0.9650
10/40 [======>.......................] - ETA: 0s - loss: 0.1160 - accuracy: 0.9660
19/40 [=============>................] - ETA: 0s - loss: 0.1155 - accuracy: 0.9650
28/40 [====================>.........] - ETA: 0s - loss: 0.1151 - accuracy: 0.9630
37/40 [==========================>...] - ETA: 0s - loss: 0.1178 - accuracy: 0.9607
40/40 [==============================] - 0s 6ms/step - loss: 0.1192 - accuracy: 0.9597

40/40 [==============================] - 0s 10ms/step - loss: 0.1192 - accuracy: 0.9597 - val_loss: 1.0751 - val_accuracy: 0.8100
Epoch 58/100

 1/40 [..............................] - ETA: 0s - loss: 0.1031 - accuracy: 0.9800
 9/40 [=====>........................] - ETA: 0s - loss: 0.0985 - accuracy: 0.9728
18/40 [============>.................] - ETA: 0s - loss: 0.1118 - accuracy: 0.9644
27/40 [===================>..........] - ETA: 0s - loss: 0.1115 - accuracy: 0.9641
37/40 [==========================>...] - ETA: 0s - loss: 0.1154 - accuracy: 0.9618
40/40 [==============================] - 0s 6ms/step - loss: 0.1156 - accuracy: 0.9618

40/40 [==============================] - 0s 10ms/step - loss: 0.1156 - accuracy: 0.9618 - val_loss: 1.0761 - val_accuracy: 0.8040
Epoch 59/100

 1/40 [..............................] - ETA: 0s - loss: 0.0800 - accuracy: 0.9650
10/40 [======>.......................] - ETA: 0s - loss: 0.1035 - accuracy: 0.9690
19/40 [=============>................] - ETA: 0s - loss: 0.1084 - accuracy: 0.9647
29/40 [====================>.........] - ETA: 0s - loss: 0.1122 - accuracy: 0.9622
39/40 [============================>.] - ETA: 0s - loss: 0.1140 - accuracy: 0.9600
40/40 [==============================] - 0s 6ms/step - loss: 0.1139 - accuracy: 0.9602

40/40 [==============================] - 0s 9ms/step - loss: 0.1139 - accuracy: 0.9602 - val_loss: 1.0754 - val_accuracy: 0.8120
Epoch 60/100

 1/40 [..............................] - ETA: 0s - loss: 0.0832 - accuracy: 0.9850
10/40 [======>.......................] - ETA: 0s - loss: 0.1009 - accuracy: 0.9630
19/40 [=============>................] - ETA: 0s - loss: 0.1020 - accuracy: 0.9645
28/40 [====================>.........] - ETA: 0s - loss: 0.1080 - accuracy: 0.9605
37/40 [==========================>...] - ETA: 0s - loss: 0.1078 - accuracy: 0.9607
40/40 [==============================] - 0s 6ms/step - loss: 0.1106 - accuracy: 0.9589

40/40 [==============================] - 0s 10ms/step - loss: 0.1106 - accuracy: 0.9589 - val_loss: 1.0832 - val_accuracy: 0.8140
Epoch 61/100

 1/40 [..............................] - ETA: 0s - loss: 0.1068 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.1069 - accuracy: 0.9675
19/40 [=============>................] - ETA: 0s - loss: 0.1037 - accuracy: 0.9650
27/40 [===================>..........] - ETA: 0s - loss: 0.1047 - accuracy: 0.9637
35/40 [=========================>....] - ETA: 0s - loss: 0.1090 - accuracy: 0.9611
40/40 [==============================] - 0s 6ms/step - loss: 0.1093 - accuracy: 0.9608

40/40 [==============================] - 0s 10ms/step - loss: 0.1093 - accuracy: 0.9608 - val_loss: 1.0869 - val_accuracy: 0.8140
Epoch 62/100

 1/40 [..............................] - ETA: 0s - loss: 0.1118 - accuracy: 0.9650
10/40 [======>.......................] - ETA: 0s - loss: 0.1120 - accuracy: 0.9605
18/40 [============>.................] - ETA: 0s - loss: 0.1103 - accuracy: 0.9600
26/40 [==================>...........] - ETA: 0s - loss: 0.1092 - accuracy: 0.9594
34/40 [========================>.....] - ETA: 0s - loss: 0.1067 - accuracy: 0.9601
40/40 [==============================] - 0s 6ms/step - loss: 0.1078 - accuracy: 0.9594

40/40 [==============================] - 0s 10ms/step - loss: 0.1078 - accuracy: 0.9594 - val_loss: 1.0876 - val_accuracy: 0.8120
Epoch 63/100

 1/40 [..............................] - ETA: 0s - loss: 0.0862 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.1009 - accuracy: 0.9720
18/40 [============>.................] - ETA: 0s - loss: 0.0938 - accuracy: 0.9714
27/40 [===================>..........] - ETA: 0s - loss: 0.0999 - accuracy: 0.9652
35/40 [=========================>....] - ETA: 0s - loss: 0.1016 - accuracy: 0.9633
40/40 [==============================] - 0s 6ms/step - loss: 0.1039 - accuracy: 0.9617

40/40 [==============================] - 0s 10ms/step - loss: 0.1039 - accuracy: 0.9617 - val_loss: 1.1097 - val_accuracy: 0.8130
Epoch 64/100

 1/40 [..............................] - ETA: 0s - loss: 0.0971 - accuracy: 0.9800
 9/40 [=====>........................] - ETA: 0s - loss: 0.0990 - accuracy: 0.9689
17/40 [===========>..................] - ETA: 0s - loss: 0.1044 - accuracy: 0.9650
26/40 [==================>...........] - ETA: 0s - loss: 0.1018 - accuracy: 0.9646
34/40 [========================>.....] - ETA: 0s - loss: 0.1013 - accuracy: 0.9635
40/40 [==============================] - 0s 6ms/step - loss: 0.1032 - accuracy: 0.9609

40/40 [==============================] - 0s 10ms/step - loss: 0.1032 - accuracy: 0.9609 - val_loss: 1.1079 - val_accuracy: 0.8060
Epoch 65/100

 1/40 [..............................] - ETA: 0s - loss: 0.0904 - accuracy: 0.9750
 9/40 [=====>........................] - ETA: 0s - loss: 0.0911 - accuracy: 0.9678
18/40 [============>.................] - ETA: 0s - loss: 0.0958 - accuracy: 0.9628
26/40 [==================>...........] - ETA: 0s - loss: 0.0986 - accuracy: 0.9615
34/40 [========================>.....] - ETA: 0s - loss: 0.1013 - accuracy: 0.9597
40/40 [==============================] - 0s 6ms/step - loss: 0.1011 - accuracy: 0.9593

40/40 [==============================] - 0s 10ms/step - loss: 0.1011 - accuracy: 0.9593 - val_loss: 1.1049 - val_accuracy: 0.8100
Epoch 66/100

 1/40 [..............................] - ETA: 0s - loss: 0.0941 - accuracy: 0.9650
 9/40 [=====>........................] - ETA: 0s - loss: 0.0904 - accuracy: 0.9683
17/40 [===========>..................] - ETA: 0s - loss: 0.1004 - accuracy: 0.9641
25/40 [=================>............] - ETA: 0s - loss: 0.0996 - accuracy: 0.9636
33/40 [=======================>......] - ETA: 0s - loss: 0.0999 - accuracy: 0.9626
40/40 [==============================] - 0s 7ms/step - loss: 0.0993 - accuracy: 0.9618

40/40 [==============================] - 0s 11ms/step - loss: 0.0993 - accuracy: 0.9618 - val_loss: 1.1051 - val_accuracy: 0.8120
Epoch 67/100

 1/40 [..............................] - ETA: 0s - loss: 0.0907 - accuracy: 0.9800
 9/40 [=====>........................] - ETA: 0s - loss: 0.0890 - accuracy: 0.9706
17/40 [===========>..................] - ETA: 0s - loss: 0.0994 - accuracy: 0.9644
25/40 [=================>............] - ETA: 0s - loss: 0.1012 - accuracy: 0.9614
33/40 [=======================>......] - ETA: 0s - loss: 0.1014 - accuracy: 0.9592
40/40 [==============================] - 0s 6ms/step - loss: 0.0987 - accuracy: 0.9600

40/40 [==============================] - 0s 10ms/step - loss: 0.0987 - accuracy: 0.9600 - val_loss: 1.1158 - val_accuracy: 0.8090
Epoch 68/100

 1/40 [..............................] - ETA: 0s - loss: 0.0628 - accuracy: 0.9750
 9/40 [=====>........................] - ETA: 0s - loss: 0.0874 - accuracy: 0.9706
18/40 [============>.................] - ETA: 0s - loss: 0.0907 - accuracy: 0.9661
26/40 [==================>...........] - ETA: 0s - loss: 0.0927 - accuracy: 0.9644
36/40 [==========================>...] - ETA: 0s - loss: 0.0929 - accuracy: 0.9622
40/40 [==============================] - 0s 6ms/step - loss: 0.0972 - accuracy: 0.9599

40/40 [==============================] - 0s 11ms/step - loss: 0.0972 - accuracy: 0.9599 - val_loss: 1.1141 - val_accuracy: 0.8090
Epoch 69/100

 1/40 [..............................] - ETA: 0s - loss: 0.0938 - accuracy: 0.9800
10/40 [======>.......................] - ETA: 0s - loss: 0.0852 - accuracy: 0.9675
19/40 [=============>................] - ETA: 0s - loss: 0.0896 - accuracy: 0.9658
28/40 [====================>.........] - ETA: 0s - loss: 0.0919 - accuracy: 0.9618
37/40 [==========================>...] - ETA: 0s - loss: 0.0935 - accuracy: 0.9605
40/40 [==============================] - 0s 6ms/step - loss: 0.0956 - accuracy: 0.9599

40/40 [==============================] - 0s 10ms/step - loss: 0.0956 - accuracy: 0.9599 - val_loss: 1.1207 - val_accuracy: 0.8100
Epoch 70/100

 1/40 [..............................] - ETA: 0s - loss: 0.0865 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.0989 - accuracy: 0.9595
18/40 [============>.................] - ETA: 0s - loss: 0.0915 - accuracy: 0.9628
27/40 [===================>..........] - ETA: 0s - loss: 0.0885 - accuracy: 0.9628
36/40 [==========================>...] - ETA: 0s - loss: 0.0917 - accuracy: 0.9606
40/40 [==============================] - 0s 6ms/step - loss: 0.0920 - accuracy: 0.9593

40/40 [==============================] - 0s 10ms/step - loss: 0.0920 - accuracy: 0.9593 - val_loss: 1.1243 - val_accuracy: 0.8100
Epoch 71/100

 1/40 [..............................] - ETA: 0s - loss: 0.0781 - accuracy: 0.9800
10/40 [======>.......................] - ETA: 0s - loss: 0.0855 - accuracy: 0.9645
19/40 [=============>................] - ETA: 0s - loss: 0.0860 - accuracy: 0.9637
28/40 [====================>.........] - ETA: 0s - loss: 0.0897 - accuracy: 0.9625
37/40 [==========================>...] - ETA: 0s - loss: 0.0919 - accuracy: 0.9607
40/40 [==============================] - 0s 6ms/step - loss: 0.0915 - accuracy: 0.9605

40/40 [==============================] - 0s 10ms/step - loss: 0.0915 - accuracy: 0.9605 - val_loss: 1.1187 - val_accuracy: 0.8100
Epoch 72/100

 1/40 [..............................] - ETA: 0s - loss: 0.0506 - accuracy: 0.9850
10/40 [======>.......................] - ETA: 0s - loss: 0.0813 - accuracy: 0.9670
19/40 [=============>................] - ETA: 0s - loss: 0.0831 - accuracy: 0.9668
28/40 [====================>.........] - ETA: 0s - loss: 0.0832 - accuracy: 0.9655
37/40 [==========================>...] - ETA: 0s - loss: 0.0900 - accuracy: 0.9619
40/40 [==============================] - 0s 6ms/step - loss: 0.0907 - accuracy: 0.9610

40/40 [==============================] - 0s 9ms/step - loss: 0.0907 - accuracy: 0.9610 - val_loss: 1.1326 - val_accuracy: 0.8090
Epoch 73/100

 1/40 [..............................] - ETA: 0s - loss: 0.0832 - accuracy: 0.9500
10/40 [======>.......................] - ETA: 0s - loss: 0.0836 - accuracy: 0.9660
19/40 [=============>................] - ETA: 0s - loss: 0.0851 - accuracy: 0.9647
28/40 [====================>.........] - ETA: 0s - loss: 0.0856 - accuracy: 0.9634
37/40 [==========================>...] - ETA: 0s - loss: 0.0896 - accuracy: 0.9605
40/40 [==============================] - 0s 6ms/step - loss: 0.0898 - accuracy: 0.9599

40/40 [==============================] - 0s 10ms/step - loss: 0.0898 - accuracy: 0.9599 - val_loss: 1.1283 - val_accuracy: 0.8090
Epoch 74/100

 1/40 [..............................] - ETA: 0s - loss: 0.1279 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.0884 - accuracy: 0.9630
19/40 [=============>................] - ETA: 0s - loss: 0.0830 - accuracy: 0.9658
28/40 [====================>.........] - ETA: 0s - loss: 0.0889 - accuracy: 0.9629
37/40 [==========================>...] - ETA: 0s - loss: 0.0901 - accuracy: 0.9611
40/40 [==============================] - 0s 6ms/step - loss: 0.0901 - accuracy: 0.9607

40/40 [==============================] - 0s 9ms/step - loss: 0.0901 - accuracy: 0.9607 - val_loss: 1.1469 - val_accuracy: 0.8100
Epoch 75/100

 1/40 [..............................] - ETA: 0s - loss: 0.0593 - accuracy: 0.9750
10/40 [======>.......................] - ETA: 0s - loss: 0.0708 - accuracy: 0.9730
19/40 [=============>................] - ETA: 0s - loss: 0.0736 - accuracy: 0.9724
28/40 [====================>.........] - ETA: 0s - loss: 0.0787 - accuracy: 0.9673
37/40 [==========================>...] - ETA: 0s - loss: 0.0844 - accuracy: 0.9634
40/40 [==============================] - 0s 6ms/step - loss: 0.0871 - accuracy: 0.9615

40/40 [==============================] - 0s 10ms/step - loss: 0.0871 - accuracy: 0.9615 - val_loss: 1.1462 - val_accuracy: 0.8090
Epoch 76/100

 1/40 [..............................] - ETA: 0s - loss: 0.0899 - accuracy: 0.9750
10/40 [======>.......................] - ETA: 0s - loss: 0.0833 - accuracy: 0.9685
20/40 [==============>...............] - ETA: 0s - loss: 0.0906 - accuracy: 0.9625
29/40 [====================>.........] - ETA: 0s - loss: 0.0874 - accuracy: 0.9612
38/40 [===========================>..] - ETA: 0s - loss: 0.0863 - accuracy: 0.9608
40/40 [==============================] - 0s 6ms/step - loss: 0.0875 - accuracy: 0.9595

40/40 [==============================] - 0s 9ms/step - loss: 0.0875 - accuracy: 0.9595 - val_loss: 1.1461 - val_accuracy: 0.8130
Epoch 77/100

 1/40 [..............................] - ETA: 0s - loss: 0.0743 - accuracy: 0.9750
11/40 [=======>......................] - ETA: 0s - loss: 0.0829 - accuracy: 0.9664
20/40 [==============>...............] - ETA: 0s - loss: 0.0858 - accuracy: 0.9645
29/40 [====================>.........] - ETA: 0s - loss: 0.0876 - accuracy: 0.9634
38/40 [===========================>..] - ETA: 0s - loss: 0.0854 - accuracy: 0.9637
40/40 [==============================] - 0s 6ms/step - loss: 0.0863 - accuracy: 0.9633

40/40 [==============================] - 0s 10ms/step - loss: 0.0863 - accuracy: 0.9633 - val_loss: 1.1445 - val_accuracy: 0.8110
Epoch 78/100

 1/40 [..............................] - ETA: 0s - loss: 0.0885 - accuracy: 0.9650
10/40 [======>.......................] - ETA: 0s - loss: 0.0930 - accuracy: 0.9620
19/40 [=============>................] - ETA: 0s - loss: 0.0847 - accuracy: 0.9624
28/40 [====================>.........] - ETA: 0s - loss: 0.0814 - accuracy: 0.9614
37/40 [==========================>...] - ETA: 0s - loss: 0.0818 - accuracy: 0.9612
40/40 [==============================] - 0s 6ms/step - loss: 0.0849 - accuracy: 0.9595

40/40 [==============================] - 0s 10ms/step - loss: 0.0849 - accuracy: 0.9595 - val_loss: 1.1546 - val_accuracy: 0.8100
Epoch 79/100

 1/40 [..............................] - ETA: 0s - loss: 0.0698 - accuracy: 0.9750
11/40 [=======>......................] - ETA: 0s - loss: 0.0811 - accuracy: 0.9673
21/40 [==============>...............] - ETA: 0s - loss: 0.0812 - accuracy: 0.9686
30/40 [=====================>........] - ETA: 0s - loss: 0.0827 - accuracy: 0.9655
40/40 [==============================] - 0s 5ms/step - loss: 0.0844 - accuracy: 0.9627

40/40 [==============================] - 0s 9ms/step - loss: 0.0844 - accuracy: 0.9627 - val_loss: 1.1768 - val_accuracy: 0.8060
Epoch 80/100

 1/40 [..............................] - ETA: 0s - loss: 0.0480 - accuracy: 0.9850
11/40 [=======>......................] - ETA: 0s - loss: 0.0746 - accuracy: 0.9714
20/40 [==============>...............] - ETA: 0s - loss: 0.0783 - accuracy: 0.9665
29/40 [====================>.........] - ETA: 0s - loss: 0.0801 - accuracy: 0.9640
38/40 [===========================>..] - ETA: 0s - loss: 0.0839 - accuracy: 0.9624
40/40 [==============================] - 0s 5ms/step - loss: 0.0845 - accuracy: 0.9615

40/40 [==============================] - 0s 9ms/step - loss: 0.0845 - accuracy: 0.9615 - val_loss: 1.1693 - val_accuracy: 0.8070
Epoch 81/100

 1/40 [..............................] - ETA: 0s - loss: 0.0725 - accuracy: 0.9650
11/40 [=======>......................] - ETA: 0s - loss: 0.0768 - accuracy: 0.9700
20/40 [==============>...............] - ETA: 0s - loss: 0.0799 - accuracy: 0.9665
29/40 [====================>.........] - ETA: 0s - loss: 0.0794 - accuracy: 0.9634
38/40 [===========================>..] - ETA: 0s - loss: 0.0837 - accuracy: 0.9605
40/40 [==============================] - 0s 6ms/step - loss: 0.0833 - accuracy: 0.9603

40/40 [==============================] - 0s 10ms/step - loss: 0.0833 - accuracy: 0.9603 - val_loss: 1.1634 - val_accuracy: 0.8140
Epoch 82/100

 1/40 [..............................] - ETA: 0s - loss: 0.0993 - accuracy: 0.9450
11/40 [=======>......................] - ETA: 0s - loss: 0.0719 - accuracy: 0.9682
21/40 [==============>...............] - ETA: 0s - loss: 0.0740 - accuracy: 0.9664
30/40 [=====================>........] - ETA: 0s - loss: 0.0792 - accuracy: 0.9625
39/40 [============================>.] - ETA: 0s - loss: 0.0796 - accuracy: 0.9612
40/40 [==============================] - 0s 6ms/step - loss: 0.0806 - accuracy: 0.9608

40/40 [==============================] - 0s 9ms/step - loss: 0.0806 - accuracy: 0.9608 - val_loss: 1.1713 - val_accuracy: 0.8100
Epoch 83/100

 1/40 [..............................] - ETA: 0s - loss: 0.0950 - accuracy: 0.9800
10/40 [======>.......................] - ETA: 0s - loss: 0.0722 - accuracy: 0.9715
19/40 [=============>................] - ETA: 0s - loss: 0.0731 - accuracy: 0.9684
29/40 [====================>.........] - ETA: 0s - loss: 0.0726 - accuracy: 0.9655
39/40 [============================>.] - ETA: 0s - loss: 0.0803 - accuracy: 0.9612
40/40 [==============================] - 0s 5ms/step - loss: 0.0807 - accuracy: 0.9607

40/40 [==============================] - 0s 9ms/step - loss: 0.0807 - accuracy: 0.9607 - val_loss: 1.1689 - val_accuracy: 0.8080
Epoch 84/100

 1/40 [..............................] - ETA: 0s - loss: 0.0445 - accuracy: 0.9800
10/40 [======>.......................] - ETA: 0s - loss: 0.0751 - accuracy: 0.9695
19/40 [=============>................] - ETA: 0s - loss: 0.0803 - accuracy: 0.9655
28/40 [====================>.........] - ETA: 0s - loss: 0.0798 - accuracy: 0.9643
37/40 [==========================>...] - ETA: 0s - loss: 0.0804 - accuracy: 0.9631
40/40 [==============================] - 0s 6ms/step - loss: 0.0810 - accuracy: 0.9623

40/40 [==============================] - 0s 10ms/step - loss: 0.0810 - accuracy: 0.9623 - val_loss: 1.1838 - val_accuracy: 0.8070
Epoch 85/100

 1/40 [..............................] - ETA: 0s - loss: 0.0692 - accuracy: 0.9750
 9/40 [=====>........................] - ETA: 0s - loss: 0.0646 - accuracy: 0.9750
18/40 [============>.................] - ETA: 0s - loss: 0.0686 - accuracy: 0.9697
27/40 [===================>..........] - ETA: 0s - loss: 0.0752 - accuracy: 0.9657
36/40 [==========================>...] - ETA: 0s - loss: 0.0799 - accuracy: 0.9614
40/40 [==============================] - 0s 6ms/step - loss: 0.0792 - accuracy: 0.9619

40/40 [==============================] - 0s 10ms/step - loss: 0.0792 - accuracy: 0.9619 - val_loss: 1.1745 - val_accuracy: 0.8090
Epoch 86/100

 1/40 [..............................] - ETA: 0s - loss: 0.0546 - accuracy: 0.9800
10/40 [======>.......................] - ETA: 0s - loss: 0.0740 - accuracy: 0.9635
19/40 [=============>................] - ETA: 0s - loss: 0.0761 - accuracy: 0.9650
29/40 [====================>.........] - ETA: 0s - loss: 0.0763 - accuracy: 0.9626
38/40 [===========================>..] - ETA: 0s - loss: 0.0788 - accuracy: 0.9611
40/40 [==============================] - 0s 6ms/step - loss: 0.0780 - accuracy: 0.9615

40/40 [==============================] - 0s 9ms/step - loss: 0.0780 - accuracy: 0.9615 - val_loss: 1.1820 - val_accuracy: 0.8080
Epoch 87/100

 1/40 [..............................] - ETA: 0s - loss: 0.0554 - accuracy: 0.9750
10/40 [======>.......................] - ETA: 0s - loss: 0.0706 - accuracy: 0.9660
19/40 [=============>................] - ETA: 0s - loss: 0.0744 - accuracy: 0.9637
29/40 [====================>.........] - ETA: 0s - loss: 0.0752 - accuracy: 0.9634
38/40 [===========================>..] - ETA: 0s - loss: 0.0778 - accuracy: 0.9611
40/40 [==============================] - 0s 6ms/step - loss: 0.0792 - accuracy: 0.9600

40/40 [==============================] - 0s 9ms/step - loss: 0.0792 - accuracy: 0.9600 - val_loss: 1.1784 - val_accuracy: 0.8110
Epoch 88/100

 1/40 [..............................] - ETA: 0s - loss: 0.0947 - accuracy: 0.9550
10/40 [======>.......................] - ETA: 0s - loss: 0.0766 - accuracy: 0.9685
19/40 [=============>................] - ETA: 0s - loss: 0.0731 - accuracy: 0.9679
28/40 [====================>.........] - ETA: 0s - loss: 0.0764 - accuracy: 0.9663
37/40 [==========================>...] - ETA: 0s - loss: 0.0769 - accuracy: 0.9642
40/40 [==============================] - 0s 6ms/step - loss: 0.0776 - accuracy: 0.9639

40/40 [==============================] - 0s 10ms/step - loss: 0.0776 - accuracy: 0.9639 - val_loss: 1.1969 - val_accuracy: 0.8070
Epoch 89/100

 1/40 [..............................] - ETA: 0s - loss: 0.0821 - accuracy: 0.9650
10/40 [======>.......................] - ETA: 0s - loss: 0.0708 - accuracy: 0.9690
19/40 [=============>................] - ETA: 0s - loss: 0.0776 - accuracy: 0.9653
28/40 [====================>.........] - ETA: 0s - loss: 0.0759 - accuracy: 0.9643
37/40 [==========================>...] - ETA: 0s - loss: 0.0770 - accuracy: 0.9620
40/40 [==============================] - 0s 6ms/step - loss: 0.0778 - accuracy: 0.9610

40/40 [==============================] - 0s 10ms/step - loss: 0.0778 - accuracy: 0.9610 - val_loss: 1.2006 - val_accuracy: 0.8070
Epoch 90/100

 1/40 [..............................] - ETA: 0s - loss: 0.0634 - accuracy: 0.9750
10/40 [======>.......................] - ETA: 0s - loss: 0.0688 - accuracy: 0.9715
19/40 [=============>................] - ETA: 0s - loss: 0.0718 - accuracy: 0.9674
28/40 [====================>.........] - ETA: 0s - loss: 0.0756 - accuracy: 0.9645
37/40 [==========================>...] - ETA: 0s - loss: 0.0775 - accuracy: 0.9630
40/40 [==============================] - 0s 6ms/step - loss: 0.0777 - accuracy: 0.9629

40/40 [==============================] - 0s 10ms/step - loss: 0.0777 - accuracy: 0.9629 - val_loss: 1.1841 - val_accuracy: 0.8050
Epoch 91/100

 1/40 [..............................] - ETA: 0s - loss: 0.0951 - accuracy: 0.9500
10/40 [======>.......................] - ETA: 0s - loss: 0.0657 - accuracy: 0.9685
19/40 [=============>................] - ETA: 0s - loss: 0.0683 - accuracy: 0.9679
28/40 [====================>.........] - ETA: 0s - loss: 0.0742 - accuracy: 0.9621
37/40 [==========================>...] - ETA: 0s - loss: 0.0769 - accuracy: 0.9593
40/40 [==============================] - 0s 6ms/step - loss: 0.0757 - accuracy: 0.9602

40/40 [==============================] - 0s 10ms/step - loss: 0.0757 - accuracy: 0.9602 - val_loss: 1.2062 - val_accuracy: 0.8030
Epoch 92/100

 1/40 [..............................] - ETA: 0s - loss: 0.0850 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.0646 - accuracy: 0.9690
19/40 [=============>................] - ETA: 0s - loss: 0.0658 - accuracy: 0.9684
28/40 [====================>.........] - ETA: 0s - loss: 0.0722 - accuracy: 0.9636
37/40 [==========================>...] - ETA: 0s - loss: 0.0745 - accuracy: 0.9614
40/40 [==============================] - 0s 6ms/step - loss: 0.0750 - accuracy: 0.9608

40/40 [==============================] - 0s 10ms/step - loss: 0.0750 - accuracy: 0.9608 - val_loss: 1.1969 - val_accuracy: 0.8020
Epoch 93/100

 1/40 [..............................] - ETA: 0s - loss: 0.0946 - accuracy: 0.9750
10/40 [======>.......................] - ETA: 0s - loss: 0.0693 - accuracy: 0.9670
19/40 [=============>................] - ETA: 0s - loss: 0.0678 - accuracy: 0.9653
28/40 [====================>.........] - ETA: 0s - loss: 0.0666 - accuracy: 0.9664
37/40 [==========================>...] - ETA: 0s - loss: 0.0735 - accuracy: 0.9635
40/40 [==============================] - 0s 6ms/step - loss: 0.0743 - accuracy: 0.9632

40/40 [==============================] - 0s 10ms/step - loss: 0.0743 - accuracy: 0.9632 - val_loss: 1.2176 - val_accuracy: 0.8020
Epoch 94/100

 1/40 [..............................] - ETA: 0s - loss: 0.0500 - accuracy: 0.9850
10/40 [======>.......................] - ETA: 0s - loss: 0.0715 - accuracy: 0.9680
19/40 [=============>................] - ETA: 0s - loss: 0.0750 - accuracy: 0.9632
28/40 [====================>.........] - ETA: 0s - loss: 0.0723 - accuracy: 0.9634
37/40 [==========================>...] - ETA: 0s - loss: 0.0734 - accuracy: 0.9623
40/40 [==============================] - 0s 6ms/step - loss: 0.0752 - accuracy: 0.9613

40/40 [==============================] - 0s 10ms/step - loss: 0.0752 - accuracy: 0.9613 - val_loss: 1.2020 - val_accuracy: 0.8070
Epoch 95/100

 1/40 [..............................] - ETA: 0s - loss: 0.0706 - accuracy: 0.9550
10/40 [======>.......................] - ETA: 0s - loss: 0.0694 - accuracy: 0.9630
19/40 [=============>................] - ETA: 0s - loss: 0.0741 - accuracy: 0.9600
28/40 [====================>.........] - ETA: 0s - loss: 0.0709 - accuracy: 0.9627
37/40 [==========================>...] - ETA: 0s - loss: 0.0721 - accuracy: 0.9609
40/40 [==============================] - 0s 6ms/step - loss: 0.0736 - accuracy: 0.9602

40/40 [==============================] - 0s 10ms/step - loss: 0.0736 - accuracy: 0.9602 - val_loss: 1.2232 - val_accuracy: 0.8020
Epoch 96/100

 1/40 [..............................] - ETA: 0s - loss: 0.0584 - accuracy: 0.9800
10/40 [======>.......................] - ETA: 0s - loss: 0.0619 - accuracy: 0.9685
19/40 [=============>................] - ETA: 0s - loss: 0.0682 - accuracy: 0.9647
28/40 [====================>.........] - ETA: 0s - loss: 0.0744 - accuracy: 0.9630
37/40 [==========================>...] - ETA: 0s - loss: 0.0730 - accuracy: 0.9618
40/40 [==============================] - 0s 6ms/step - loss: 0.0721 - accuracy: 0.9622

40/40 [==============================] - 0s 10ms/step - loss: 0.0721 - accuracy: 0.9622 - val_loss: 1.2190 - val_accuracy: 0.8070
Epoch 97/100

 1/40 [..............................] - ETA: 0s - loss: 0.0758 - accuracy: 0.9700
10/40 [======>.......................] - ETA: 0s - loss: 0.0702 - accuracy: 0.9675
19/40 [=============>................] - ETA: 0s - loss: 0.0724 - accuracy: 0.9661
28/40 [====================>.........] - ETA: 0s - loss: 0.0723 - accuracy: 0.9648
37/40 [==========================>...] - ETA: 0s - loss: 0.0736 - accuracy: 0.9620
40/40 [==============================] - 0s 6ms/step - loss: 0.0734 - accuracy: 0.9624

40/40 [==============================] - 0s 10ms/step - loss: 0.0734 - accuracy: 0.9624 - val_loss: 1.2120 - val_accuracy: 0.8120
Epoch 98/100

 1/40 [..............................] - ETA: 0s - loss: 0.0510 - accuracy: 0.9850
10/40 [======>.......................] - ETA: 0s - loss: 0.0704 - accuracy: 0.9665
19/40 [=============>................] - ETA: 0s - loss: 0.0686 - accuracy: 0.9639
28/40 [====================>.........] - ETA: 0s - loss: 0.0728 - accuracy: 0.9623
37/40 [==========================>...] - ETA: 0s - loss: 0.0740 - accuracy: 0.9608
40/40 [==============================] - 0s 6ms/step - loss: 0.0736 - accuracy: 0.9605

40/40 [==============================] - 0s 10ms/step - loss: 0.0736 - accuracy: 0.9605 - val_loss: 1.2158 - val_accuracy: 0.8060
Epoch 99/100

 1/40 [..............................] - ETA: 0s - loss: 0.0773 - accuracy: 0.9500
10/40 [======>.......................] - ETA: 0s - loss: 0.0713 - accuracy: 0.9655
19/40 [=============>................] - ETA: 0s - loss: 0.0704 - accuracy: 0.9647
28/40 [====================>.........] - ETA: 0s - loss: 0.0691 - accuracy: 0.9639
37/40 [==========================>...] - ETA: 0s - loss: 0.0700 - accuracy: 0.9624
40/40 [==============================] - 0s 6ms/step - loss: 0.0718 - accuracy: 0.9614

40/40 [==============================] - 0s 10ms/step - loss: 0.0718 - accuracy: 0.9614 - val_loss: 1.2218 - val_accuracy: 0.8080
Epoch 100/100

 1/40 [..............................] - ETA: 0s - loss: 0.0399 - accuracy: 0.9850
10/40 [======>.......................] - ETA: 0s - loss: 0.0634 - accuracy: 0.9705
19/40 [=============>................] - ETA: 0s - loss: 0.0669 - accuracy: 0.9663
28/40 [====================>.........] - ETA: 0s - loss: 0.0674 - accuracy: 0.9645
37/40 [==========================>...] - ETA: 0s - loss: 0.0714 - accuracy: 0.9624
40/40 [==============================] - 0s 6ms/step - loss: 0.0722 - accuracy: 0.9614

40/40 [==============================] - 0s 10ms/step - loss: 0.0722 - accuracy: 0.9614 - val_loss: 1.2215 - val_accuracy: 0.8050

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-01T18-52-12Z

Training run 8/8 (flags = list(128, 1e-04, 100, 30, "tanh")) 
Using run directory runs/2020-11-01T18-52-54Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = 10000) %>%
+         layer_dense( units = FLAGS$n .... [TRUNCATED] 

> set.seed(123)

> model %>% compile (
+         loss = 'sparse_categorical_crossentropy',
+         optimizer = optimizer_adam(lr=FLAGS$learning_rate),
+         metr .... [TRUNCATED] 

> model %>% fit (x = reuters_train, y = reuters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = list(reuters_val .... [TRUNCATED] 
Epoch 1/30

 1/80 [..............................] - ETA: 0s - loss: 3.7996 - accuracy: 0.0300
11/80 [===>..........................] - ETA: 0s - loss: 3.7083 - accuracy: 0.2000
21/80 [======>.......................] - ETA: 0s - loss: 3.5971 - accuracy: 0.3276
31/80 [==========>...................] - ETA: 0s - loss: 3.4791 - accuracy: 0.3810
42/80 [==============>...............] - ETA: 0s - loss: 3.3402 - accuracy: 0.4136
52/80 [==================>...........] - ETA: 0s - loss: 3.2041 - accuracy: 0.4392
62/80 [======================>.......] - ETA: 0s - loss: 3.0760 - accuracy: 0.4573
71/80 [=========================>....] - ETA: 0s - loss: 2.9702 - accuracy: 0.4685
80/80 [==============================] - 0s 5ms/step - loss: 2.8748 - accuracy: 0.4777

80/80 [==============================] - 1s 13ms/step - loss: 2.8748 - accuracy: 0.4777 - val_loss: 2.0552 - val_accuracy: 0.5490
Epoch 2/30

 1/80 [..............................] - ETA: 0s - loss: 1.9181 - accuracy: 0.5700
10/80 [==>...........................] - ETA: 0s - loss: 1.9647 - accuracy: 0.5570
19/80 [======>.......................] - ETA: 0s - loss: 1.9433 - accuracy: 0.5642
29/80 [=========>....................] - ETA: 0s - loss: 1.9010 - accuracy: 0.5793
40/80 [==============>...............] - ETA: 0s - loss: 1.8323 - accuracy: 0.5993
51/80 [==================>...........] - ETA: 0s - loss: 1.7996 - accuracy: 0.6043
61/80 [=====================>........] - ETA: 0s - loss: 1.7724 - accuracy: 0.6062
71/80 [=========================>....] - ETA: 0s - loss: 1.7544 - accuracy: 0.6083
80/80 [==============================] - 0s 5ms/step - loss: 1.7237 - accuracy: 0.6158

80/80 [==============================] - 1s 7ms/step - loss: 1.7237 - accuracy: 0.6158 - val_loss: 1.5400 - val_accuracy: 0.6500
Epoch 3/30

 1/80 [..............................] - ETA: 0s - loss: 1.4065 - accuracy: 0.6800
11/80 [===>..........................] - ETA: 0s - loss: 1.4148 - accuracy: 0.6882
22/80 [=======>......................] - ETA: 0s - loss: 1.4224 - accuracy: 0.6918
32/80 [===========>..................] - ETA: 0s - loss: 1.4260 - accuracy: 0.6844
42/80 [==============>...............] - ETA: 0s - loss: 1.4060 - accuracy: 0.6929
52/80 [==================>...........] - ETA: 0s - loss: 1.3895 - accuracy: 0.6965
63/80 [======================>.......] - ETA: 0s - loss: 1.3701 - accuracy: 0.7003
73/80 [==========================>...] - ETA: 0s - loss: 1.3648 - accuracy: 0.7029
80/80 [==============================] - 0s 5ms/step - loss: 1.3572 - accuracy: 0.7047

80/80 [==============================] - 1s 7ms/step - loss: 1.3572 - accuracy: 0.7047 - val_loss: 1.3132 - val_accuracy: 0.6990
Epoch 4/30

 1/80 [..............................] - ETA: 0s - loss: 1.2641 - accuracy: 0.7200
12/80 [===>..........................] - ETA: 0s - loss: 1.1839 - accuracy: 0.7408
23/80 [=======>......................] - ETA: 0s - loss: 1.1672 - accuracy: 0.7448
34/80 [===========>..................] - ETA: 0s - loss: 1.1681 - accuracy: 0.7488
44/80 [===============>..............] - ETA: 0s - loss: 1.1514 - accuracy: 0.7509
54/80 [===================>..........] - ETA: 0s - loss: 1.1378 - accuracy: 0.7544
64/80 [=======================>......] - ETA: 0s - loss: 1.1332 - accuracy: 0.7561
74/80 [==========================>...] - ETA: 0s - loss: 1.1182 - accuracy: 0.7582
80/80 [==============================] - 0s 5ms/step - loss: 1.1171 - accuracy: 0.7591

80/80 [==============================] - 1s 7ms/step - loss: 1.1171 - accuracy: 0.7591 - val_loss: 1.1651 - val_accuracy: 0.7380
Epoch 5/30

 1/80 [..............................] - ETA: 0s - loss: 1.0765 - accuracy: 0.7400
11/80 [===>..........................] - ETA: 0s - loss: 0.9907 - accuracy: 0.7873
21/80 [======>.......................] - ETA: 0s - loss: 0.9812 - accuracy: 0.7852
31/80 [==========>...................] - ETA: 0s - loss: 0.9813 - accuracy: 0.7887
41/80 [==============>...............] - ETA: 0s - loss: 0.9617 - accuracy: 0.7922
51/80 [==================>...........] - ETA: 0s - loss: 0.9687 - accuracy: 0.7910
62/80 [======================>.......] - ETA: 0s - loss: 0.9595 - accuracy: 0.7913
73/80 [==========================>...] - ETA: 0s - loss: 0.9488 - accuracy: 0.7949
80/80 [==============================] - 0s 5ms/step - loss: 0.9371 - accuracy: 0.7984

80/80 [==============================] - 1s 7ms/step - loss: 0.9371 - accuracy: 0.7984 - val_loss: 1.0684 - val_accuracy: 0.7650
Epoch 6/30

 1/80 [..............................] - ETA: 0s - loss: 0.8836 - accuracy: 0.8000
11/80 [===>..........................] - ETA: 0s - loss: 0.7984 - accuracy: 0.8291
21/80 [======>.......................] - ETA: 0s - loss: 0.8213 - accuracy: 0.8243
32/80 [===========>..................] - ETA: 0s - loss: 0.8133 - accuracy: 0.8259
42/80 [==============>...............] - ETA: 0s - loss: 0.8016 - accuracy: 0.8288
53/80 [==================>...........] - ETA: 0s - loss: 0.7924 - accuracy: 0.8306
64/80 [=======================>......] - ETA: 0s - loss: 0.7958 - accuracy: 0.8306
74/80 [==========================>...] - ETA: 0s - loss: 0.7940 - accuracy: 0.8314
80/80 [==============================] - 0s 5ms/step - loss: 0.7971 - accuracy: 0.8309

80/80 [==============================] - 1s 7ms/step - loss: 0.7971 - accuracy: 0.8309 - val_loss: 1.0033 - val_accuracy: 0.7840
Epoch 7/30

 1/80 [..............................] - ETA: 0s - loss: 0.7546 - accuracy: 0.8200
11/80 [===>..........................] - ETA: 0s - loss: 0.7182 - accuracy: 0.8564
22/80 [=======>......................] - ETA: 0s - loss: 0.7257 - accuracy: 0.8555
32/80 [===========>..................] - ETA: 0s - loss: 0.7184 - accuracy: 0.8562
42/80 [==============>...............] - ETA: 0s - loss: 0.7093 - accuracy: 0.8560
51/80 [==================>...........] - ETA: 0s - loss: 0.7013 - accuracy: 0.8573
61/80 [=====================>........] - ETA: 0s - loss: 0.6993 - accuracy: 0.8577
72/80 [==========================>...] - ETA: 0s - loss: 0.6921 - accuracy: 0.8594
80/80 [==============================] - 0s 5ms/step - loss: 0.6854 - accuracy: 0.8598

80/80 [==============================] - 1s 7ms/step - loss: 0.6854 - accuracy: 0.8598 - val_loss: 0.9531 - val_accuracy: 0.7980
Epoch 8/30

 1/80 [..............................] - ETA: 0s - loss: 0.8136 - accuracy: 0.8200
12/80 [===>..........................] - ETA: 0s - loss: 0.6044 - accuracy: 0.8725
23/80 [=======>......................] - ETA: 0s - loss: 0.6086 - accuracy: 0.8752
34/80 [===========>..................] - ETA: 0s - loss: 0.6097 - accuracy: 0.8735
44/80 [===============>..............] - ETA: 0s - loss: 0.6056 - accuracy: 0.8755
54/80 [===================>..........] - ETA: 0s - loss: 0.6025 - accuracy: 0.8763
64/80 [=======================>......] - ETA: 0s - loss: 0.5980 - accuracy: 0.8778
75/80 [===========================>..] - ETA: 0s - loss: 0.5927 - accuracy: 0.8812
80/80 [==============================] - 0s 5ms/step - loss: 0.5914 - accuracy: 0.8817

80/80 [==============================] - 1s 7ms/step - loss: 0.5914 - accuracy: 0.8817 - val_loss: 0.9226 - val_accuracy: 0.7960
Epoch 9/30

 1/80 [..............................] - ETA: 0s - loss: 0.5150 - accuracy: 0.8800
11/80 [===>..........................] - ETA: 0s - loss: 0.5541 - accuracy: 0.8982
22/80 [=======>......................] - ETA: 0s - loss: 0.5430 - accuracy: 0.8977
32/80 [===========>..................] - ETA: 0s - loss: 0.5308 - accuracy: 0.9000
42/80 [==============>...............] - ETA: 0s - loss: 0.5251 - accuracy: 0.8990
52/80 [==================>...........] - ETA: 0s - loss: 0.5237 - accuracy: 0.8988
63/80 [======================>.......] - ETA: 0s - loss: 0.5214 - accuracy: 0.8981
73/80 [==========================>...] - ETA: 0s - loss: 0.5187 - accuracy: 0.8996
80/80 [==============================] - 0s 5ms/step - loss: 0.5124 - accuracy: 0.8994

80/80 [==============================] - 1s 7ms/step - loss: 0.5124 - accuracy: 0.8994 - val_loss: 0.8963 - val_accuracy: 0.8040
Epoch 10/30

 1/80 [..............................] - ETA: 0s - loss: 0.4878 - accuracy: 0.8700
11/80 [===>..........................] - ETA: 0s - loss: 0.4399 - accuracy: 0.9118
22/80 [=======>......................] - ETA: 0s - loss: 0.4355 - accuracy: 0.9186
32/80 [===========>..................] - ETA: 0s - loss: 0.4519 - accuracy: 0.9156
42/80 [==============>...............] - ETA: 0s - loss: 0.4446 - accuracy: 0.9188
53/80 [==================>...........] - ETA: 0s - loss: 0.4511 - accuracy: 0.9185
63/80 [======================>.......] - ETA: 0s - loss: 0.4431 - accuracy: 0.9183
74/80 [==========================>...] - ETA: 0s - loss: 0.4416 - accuracy: 0.9176
80/80 [==============================] - 0s 5ms/step - loss: 0.4452 - accuracy: 0.9159

80/80 [==============================] - 1s 7ms/step - loss: 0.4452 - accuracy: 0.9159 - val_loss: 0.8767 - val_accuracy: 0.8090
Epoch 11/30

 1/80 [..............................] - ETA: 0s - loss: 0.3959 - accuracy: 0.9100
11/80 [===>..........................] - ETA: 0s - loss: 0.4175 - accuracy: 0.9255
21/80 [======>.......................] - ETA: 0s - loss: 0.3840 - accuracy: 0.9333
31/80 [==========>...................] - ETA: 0s - loss: 0.3785 - accuracy: 0.9361
41/80 [==============>...............] - ETA: 0s - loss: 0.3862 - accuracy: 0.9312
51/80 [==================>...........] - ETA: 0s - loss: 0.3818 - accuracy: 0.9302
62/80 [======================>.......] - ETA: 0s - loss: 0.3846 - accuracy: 0.9292
73/80 [==========================>...] - ETA: 0s - loss: 0.3839 - accuracy: 0.9292
80/80 [==============================] - 0s 5ms/step - loss: 0.3882 - accuracy: 0.9275

80/80 [==============================] - 1s 7ms/step - loss: 0.3882 - accuracy: 0.9275 - val_loss: 0.8624 - val_accuracy: 0.8130
Epoch 12/30

 1/80 [..............................] - ETA: 0s - loss: 0.2981 - accuracy: 0.9400
11/80 [===>..........................] - ETA: 0s - loss: 0.3569 - accuracy: 0.9309
22/80 [=======>......................] - ETA: 0s - loss: 0.3387 - accuracy: 0.9400
33/80 [===========>..................] - ETA: 0s - loss: 0.3446 - accuracy: 0.9373
43/80 [===============>..............] - ETA: 0s - loss: 0.3403 - accuracy: 0.9367
53/80 [==================>...........] - ETA: 0s - loss: 0.3400 - accuracy: 0.9372
63/80 [======================>.......] - ETA: 0s - loss: 0.3391 - accuracy: 0.9376
74/80 [==========================>...] - ETA: 0s - loss: 0.3385 - accuracy: 0.9359
80/80 [==============================] - 0s 5ms/step - loss: 0.3402 - accuracy: 0.9349

80/80 [==============================] - 1s 7ms/step - loss: 0.3402 - accuracy: 0.9349 - val_loss: 0.8519 - val_accuracy: 0.8190
Epoch 13/30

 1/80 [..............................] - ETA: 0s - loss: 0.1778 - accuracy: 0.9600
11/80 [===>..........................] - ETA: 0s - loss: 0.2619 - accuracy: 0.9473
21/80 [======>.......................] - ETA: 0s - loss: 0.2676 - accuracy: 0.9505
31/80 [==========>...................] - ETA: 0s - loss: 0.2852 - accuracy: 0.9465
41/80 [==============>...............] - ETA: 0s - loss: 0.2949 - accuracy: 0.9451
52/80 [==================>...........] - ETA: 0s - loss: 0.2960 - accuracy: 0.9435
62/80 [======================>.......] - ETA: 0s - loss: 0.2988 - accuracy: 0.9427
72/80 [==========================>...] - ETA: 0s - loss: 0.3002 - accuracy: 0.9418
80/80 [==============================] - 0s 5ms/step - loss: 0.2987 - accuracy: 0.9422

80/80 [==============================] - 1s 7ms/step - loss: 0.2987 - accuracy: 0.9422 - val_loss: 0.8444 - val_accuracy: 0.8200
Epoch 14/30

 1/80 [..............................] - ETA: 0s - loss: 0.3104 - accuracy: 0.9600
12/80 [===>..........................] - ETA: 0s - loss: 0.2644 - accuracy: 0.9558
23/80 [=======>......................] - ETA: 0s - loss: 0.2652 - accuracy: 0.9530
34/80 [===========>..................] - ETA: 0s - loss: 0.2577 - accuracy: 0.9526
44/80 [===============>..............] - ETA: 0s - loss: 0.2590 - accuracy: 0.9516
54/80 [===================>..........] - ETA: 0s - loss: 0.2595 - accuracy: 0.9504
64/80 [=======================>......] - ETA: 0s - loss: 0.2581 - accuracy: 0.9497
74/80 [==========================>...] - ETA: 0s - loss: 0.2606 - accuracy: 0.9480
80/80 [==============================] - 0s 5ms/step - loss: 0.2655 - accuracy: 0.9464

80/80 [==============================] - 1s 7ms/step - loss: 0.2655 - accuracy: 0.9464 - val_loss: 0.8469 - val_accuracy: 0.8180
Epoch 15/30

 1/80 [..............................] - ETA: 0s - loss: 0.1222 - accuracy: 0.9800
11/80 [===>..........................] - ETA: 0s - loss: 0.2282 - accuracy: 0.9527
21/80 [======>.......................] - ETA: 0s - loss: 0.2160 - accuracy: 0.9557
31/80 [==========>...................] - ETA: 0s - loss: 0.2304 - accuracy: 0.9506
41/80 [==============>...............] - ETA: 0s - loss: 0.2343 - accuracy: 0.9505
51/80 [==================>...........] - ETA: 0s - loss: 0.2347 - accuracy: 0.9498
61/80 [=====================>........] - ETA: 0s - loss: 0.2303 - accuracy: 0.9510
71/80 [=========================>....] - ETA: 0s - loss: 0.2325 - accuracy: 0.9492
80/80 [==============================] - 0s 5ms/step - loss: 0.2360 - accuracy: 0.9474

80/80 [==============================] - 1s 7ms/step - loss: 0.2360 - accuracy: 0.9474 - val_loss: 0.8393 - val_accuracy: 0.8120
Epoch 16/30

 1/80 [..............................] - ETA: 0s - loss: 0.1948 - accuracy: 0.9500
11/80 [===>..........................] - ETA: 0s - loss: 0.2186 - accuracy: 0.9564
21/80 [======>.......................] - ETA: 0s - loss: 0.2162 - accuracy: 0.9519
31/80 [==========>...................] - ETA: 0s - loss: 0.2110 - accuracy: 0.9558
41/80 [==============>...............] - ETA: 0s - loss: 0.2054 - accuracy: 0.9571
50/80 [=================>............] - ETA: 0s - loss: 0.2094 - accuracy: 0.9554
60/80 [=====================>........] - ETA: 0s - loss: 0.2093 - accuracy: 0.9530
70/80 [=========================>....] - ETA: 0s - loss: 0.2099 - accuracy: 0.9531
80/80 [==============================] - 0s 5ms/step - loss: 0.2113 - accuracy: 0.9511

80/80 [==============================] - 1s 7ms/step - loss: 0.2113 - accuracy: 0.9511 - val_loss: 0.8382 - val_accuracy: 0.8180
Epoch 17/30

 1/80 [..............................] - ETA: 0s - loss: 0.1288 - accuracy: 0.9800
11/80 [===>..........................] - ETA: 0s - loss: 0.1696 - accuracy: 0.9609
21/80 [======>.......................] - ETA: 0s - loss: 0.1637 - accuracy: 0.9633
31/80 [==========>...................] - ETA: 0s - loss: 0.1648 - accuracy: 0.9642
41/80 [==============>...............] - ETA: 0s - loss: 0.1705 - accuracy: 0.9627
51/80 [==================>...........] - ETA: 0s - loss: 0.1817 - accuracy: 0.9592
61/80 [=====================>........] - ETA: 0s - loss: 0.1862 - accuracy: 0.9569
71/80 [=========================>....] - ETA: 0s - loss: 0.1898 - accuracy: 0.9542
80/80 [==============================] - 0s 5ms/step - loss: 0.1925 - accuracy: 0.9524

80/80 [==============================] - 1s 7ms/step - loss: 0.1925 - accuracy: 0.9524 - val_loss: 0.8433 - val_accuracy: 0.8200
Epoch 18/30

 1/80 [..............................] - ETA: 0s - loss: 0.1154 - accuracy: 1.0000
11/80 [===>..........................] - ETA: 0s - loss: 0.1801 - accuracy: 0.9591
22/80 [=======>......................] - ETA: 0s - loss: 0.1651 - accuracy: 0.9627
32/80 [===========>..................] - ETA: 0s - loss: 0.1734 - accuracy: 0.9578
42/80 [==============>...............] - ETA: 0s - loss: 0.1709 - accuracy: 0.9562
52/80 [==================>...........] - ETA: 0s - loss: 0.1708 - accuracy: 0.9552
62/80 [======================>.......] - ETA: 0s - loss: 0.1705 - accuracy: 0.9550
72/80 [==========================>...] - ETA: 0s - loss: 0.1715 - accuracy: 0.9547
80/80 [==============================] - 0s 5ms/step - loss: 0.1756 - accuracy: 0.9526

80/80 [==============================] - 1s 7ms/step - loss: 0.1756 - accuracy: 0.9526 - val_loss: 0.8458 - val_accuracy: 0.8130
Epoch 19/30

 1/80 [..............................] - ETA: 0s - loss: 0.0846 - accuracy: 0.9800
11/80 [===>..........................] - ETA: 0s - loss: 0.1517 - accuracy: 0.9591
21/80 [======>.......................] - ETA: 0s - loss: 0.1584 - accuracy: 0.9586
31/80 [==========>...................] - ETA: 0s - loss: 0.1560 - accuracy: 0.9594
41/80 [==============>...............] - ETA: 0s - loss: 0.1595 - accuracy: 0.9568
51/80 [==================>...........] - ETA: 0s - loss: 0.1589 - accuracy: 0.9571
61/80 [=====================>........] - ETA: 0s - loss: 0.1609 - accuracy: 0.9564
71/80 [=========================>....] - ETA: 0s - loss: 0.1615 - accuracy: 0.9559
80/80 [==============================] - 0s 5ms/step - loss: 0.1617 - accuracy: 0.9546

80/80 [==============================] - 1s 7ms/step - loss: 0.1617 - accuracy: 0.9546 - val_loss: 0.8476 - val_accuracy: 0.8100
Epoch 20/30

 1/80 [..............................] - ETA: 0s - loss: 0.1762 - accuracy: 0.9400
11/80 [===>..........................] - ETA: 0s - loss: 0.1263 - accuracy: 0.9673
22/80 [=======>......................] - ETA: 0s - loss: 0.1406 - accuracy: 0.9659
32/80 [===========>..................] - ETA: 0s - loss: 0.1418 - accuracy: 0.9625
42/80 [==============>...............] - ETA: 0s - loss: 0.1434 - accuracy: 0.9602
52/80 [==================>...........] - ETA: 0s - loss: 0.1467 - accuracy: 0.9583
62/80 [======================>.......] - ETA: 0s - loss: 0.1467 - accuracy: 0.9582
72/80 [==========================>...] - ETA: 0s - loss: 0.1480 - accuracy: 0.9567
80/80 [==============================] - 0s 5ms/step - loss: 0.1488 - accuracy: 0.9559

80/80 [==============================] - 1s 7ms/step - loss: 0.1488 - accuracy: 0.9559 - val_loss: 0.8563 - val_accuracy: 0.8130
Epoch 21/30

 1/80 [..............................] - ETA: 0s - loss: 0.1245 - accuracy: 0.9700
11/80 [===>..........................] - ETA: 0s - loss: 0.1561 - accuracy: 0.9545
21/80 [======>.......................] - ETA: 0s - loss: 0.1411 - accuracy: 0.9567
31/80 [==========>...................] - ETA: 0s - loss: 0.1331 - accuracy: 0.9606
41/80 [==============>...............] - ETA: 0s - loss: 0.1313 - accuracy: 0.9620
51/80 [==================>...........] - ETA: 0s - loss: 0.1340 - accuracy: 0.9602
61/80 [=====================>........] - ETA: 0s - loss: 0.1362 - accuracy: 0.9585
71/80 [=========================>....] - ETA: 0s - loss: 0.1387 - accuracy: 0.9579
80/80 [==============================] - 0s 5ms/step - loss: 0.1400 - accuracy: 0.9564

80/80 [==============================] - 1s 7ms/step - loss: 0.1400 - accuracy: 0.9564 - val_loss: 0.8592 - val_accuracy: 0.8120
Epoch 22/30

 1/80 [..............................] - ETA: 0s - loss: 0.1295 - accuracy: 0.9600
11/80 [===>..........................] - ETA: 0s - loss: 0.1201 - accuracy: 0.9691
21/80 [======>.......................] - ETA: 0s - loss: 0.1179 - accuracy: 0.9686
31/80 [==========>...................] - ETA: 0s - loss: 0.1169 - accuracy: 0.9665
41/80 [==============>...............] - ETA: 0s - loss: 0.1149 - accuracy: 0.9676
51/80 [==================>...........] - ETA: 0s - loss: 0.1178 - accuracy: 0.9653
61/80 [=====================>........] - ETA: 0s - loss: 0.1212 - accuracy: 0.9634
69/80 [========================>.....] - ETA: 0s - loss: 0.1287 - accuracy: 0.9601
79/80 [============================>.] - ETA: 0s - loss: 0.1309 - accuracy: 0.9586
80/80 [==============================] - 0s 5ms/step - loss: 0.1308 - accuracy: 0.9585

80/80 [==============================] - 1s 7ms/step - loss: 0.1308 - accuracy: 0.9585 - val_loss: 0.8639 - val_accuracy: 0.8110
Epoch 23/30

 1/80 [..............................] - ETA: 0s - loss: 0.0883 - accuracy: 0.9700
11/80 [===>..........................] - ETA: 0s - loss: 0.1181 - accuracy: 0.9618
21/80 [======>.......................] - ETA: 0s - loss: 0.1174 - accuracy: 0.9629
31/80 [==========>...................] - ETA: 0s - loss: 0.1187 - accuracy: 0.9603
40/80 [==============>...............] - ETA: 0s - loss: 0.1167 - accuracy: 0.9620
49/80 [=================>............] - ETA: 0s - loss: 0.1161 - accuracy: 0.9629
59/80 [=====================>........] - ETA: 0s - loss: 0.1201 - accuracy: 0.9602
69/80 [========================>.....] - ETA: 0s - loss: 0.1229 - accuracy: 0.9583
79/80 [============================>.] - ETA: 0s - loss: 0.1241 - accuracy: 0.9568
80/80 [==============================] - 0s 5ms/step - loss: 0.1243 - accuracy: 0.9568

80/80 [==============================] - 1s 7ms/step - loss: 0.1243 - accuracy: 0.9568 - val_loss: 0.8685 - val_accuracy: 0.8060
Epoch 24/30

 1/80 [..............................] - ETA: 0s - loss: 0.1250 - accuracy: 0.9300
11/80 [===>..........................] - ETA: 0s - loss: 0.1035 - accuracy: 0.9627
21/80 [======>.......................] - ETA: 0s - loss: 0.1031 - accuracy: 0.9633
31/80 [==========>...................] - ETA: 0s - loss: 0.1058 - accuracy: 0.9616
41/80 [==============>...............] - ETA: 0s - loss: 0.1091 - accuracy: 0.9602
51/80 [==================>...........] - ETA: 0s - loss: 0.1143 - accuracy: 0.9573
61/80 [=====================>........] - ETA: 0s - loss: 0.1150 - accuracy: 0.9577
71/80 [=========================>....] - ETA: 0s - loss: 0.1166 - accuracy: 0.9556
80/80 [==============================] - 0s 5ms/step - loss: 0.1171 - accuracy: 0.9559

80/80 [==============================] - 1s 7ms/step - loss: 0.1171 - accuracy: 0.9559 - val_loss: 0.8780 - val_accuracy: 0.8050
Epoch 25/30

 1/80 [..............................] - ETA: 0s - loss: 0.1035 - accuracy: 0.9800
11/80 [===>..........................] - ETA: 0s - loss: 0.1227 - accuracy: 0.9555
21/80 [======>.......................] - ETA: 0s - loss: 0.1228 - accuracy: 0.9581
31/80 [==========>...................] - ETA: 0s - loss: 0.1216 - accuracy: 0.9574
41/80 [==============>...............] - ETA: 0s - loss: 0.1186 - accuracy: 0.9583
50/80 [=================>............] - ETA: 0s - loss: 0.1139 - accuracy: 0.9598
60/80 [=====================>........] - ETA: 0s - loss: 0.1113 - accuracy: 0.9598
70/80 [=========================>....] - ETA: 0s - loss: 0.1120 - accuracy: 0.9583
80/80 [==============================] - 0s 5ms/step - loss: 0.1117 - accuracy: 0.9583

80/80 [==============================] - 1s 7ms/step - loss: 0.1117 - accuracy: 0.9583 - val_loss: 0.8780 - val_accuracy: 0.8090
Epoch 26/30

 1/80 [..............................] - ETA: 0s - loss: 0.1334 - accuracy: 0.9600
11/80 [===>..........................] - ETA: 0s - loss: 0.0998 - accuracy: 0.9655
21/80 [======>.......................] - ETA: 0s - loss: 0.1038 - accuracy: 0.9648
31/80 [==========>...................] - ETA: 0s - loss: 0.1043 - accuracy: 0.9632
41/80 [==============>...............] - ETA: 0s - loss: 0.1038 - accuracy: 0.9617
51/80 [==================>...........] - ETA: 0s - loss: 0.1045 - accuracy: 0.9618
61/80 [=====================>........] - ETA: 0s - loss: 0.1019 - accuracy: 0.9630
71/80 [=========================>....] - ETA: 0s - loss: 0.1037 - accuracy: 0.9614
80/80 [==============================] - 0s 5ms/step - loss: 0.1077 - accuracy: 0.9589

80/80 [==============================] - 1s 7ms/step - loss: 0.1077 - accuracy: 0.9589 - val_loss: 0.8837 - val_accuracy: 0.8100
Epoch 27/30

 1/80 [..............................] - ETA: 0s - loss: 0.0786 - accuracy: 0.9700
11/80 [===>..........................] - ETA: 0s - loss: 0.0910 - accuracy: 0.9664
21/80 [======>.......................] - ETA: 0s - loss: 0.0961 - accuracy: 0.9648
31/80 [==========>...................] - ETA: 0s - loss: 0.0915 - accuracy: 0.9668
41/80 [==============>...............] - ETA: 0s - loss: 0.0951 - accuracy: 0.9627
51/80 [==================>...........] - ETA: 0s - loss: 0.0996 - accuracy: 0.9606
61/80 [=====================>........] - ETA: 0s - loss: 0.1023 - accuracy: 0.9598
71/80 [=========================>....] - ETA: 0s - loss: 0.1016 - accuracy: 0.9596
80/80 [==============================] - 0s 5ms/step - loss: 0.1037 - accuracy: 0.9577

80/80 [==============================] - 1s 7ms/step - loss: 0.1037 - accuracy: 0.9577 - val_loss: 0.8822 - val_accuracy: 0.8100
Epoch 28/30

 1/80 [..............................] - ETA: 0s - loss: 0.0869 - accuracy: 0.9700
11/80 [===>..........................] - ETA: 0s - loss: 0.0747 - accuracy: 0.9791
21/80 [======>.......................] - ETA: 0s - loss: 0.0815 - accuracy: 0.9748
31/80 [==========>...................] - ETA: 0s - loss: 0.0833 - accuracy: 0.9713
40/80 [==============>...............] - ETA: 0s - loss: 0.0902 - accuracy: 0.9668
50/80 [=================>............] - ETA: 0s - loss: 0.0942 - accuracy: 0.9632
60/80 [=====================>........] - ETA: 0s - loss: 0.0969 - accuracy: 0.9615
70/80 [=========================>....] - ETA: 0s - loss: 0.0980 - accuracy: 0.9601
80/80 [==============================] - 0s 5ms/step - loss: 0.1004 - accuracy: 0.9585

80/80 [==============================] - 1s 7ms/step - loss: 0.1004 - accuracy: 0.9585 - val_loss: 0.8945 - val_accuracy: 0.8080
Epoch 29/30

 1/80 [..............................] - ETA: 0s - loss: 0.0642 - accuracy: 0.9800
11/80 [===>..........................] - ETA: 0s - loss: 0.0826 - accuracy: 0.9682
21/80 [======>.......................] - ETA: 0s - loss: 0.0895 - accuracy: 0.9676
31/80 [==========>...................] - ETA: 0s - loss: 0.0932 - accuracy: 0.9677
41/80 [==============>...............] - ETA: 0s - loss: 0.0958 - accuracy: 0.9639
51/80 [==================>...........] - ETA: 0s - loss: 0.0943 - accuracy: 0.9631
61/80 [=====================>........] - ETA: 0s - loss: 0.0948 - accuracy: 0.9616
70/80 [=========================>....] - ETA: 0s - loss: 0.0957 - accuracy: 0.9603
80/80 [==============================] - 0s 5ms/step - loss: 0.0973 - accuracy: 0.9590

80/80 [==============================] - 1s 7ms/step - loss: 0.0973 - accuracy: 0.9590 - val_loss: 0.9091 - val_accuracy: 0.8080
Epoch 30/30

 1/80 [..............................] - ETA: 0s - loss: 0.1025 - accuracy: 0.9600
11/80 [===>..........................] - ETA: 0s - loss: 0.0887 - accuracy: 0.9655
21/80 [======>.......................] - ETA: 0s - loss: 0.0875 - accuracy: 0.9638
30/80 [==========>...................] - ETA: 0s - loss: 0.0875 - accuracy: 0.9637
40/80 [==============>...............] - ETA: 0s - loss: 0.0868 - accuracy: 0.9635
50/80 [=================>............] - ETA: 0s - loss: 0.0891 - accuracy: 0.9620
60/80 [=====================>........] - ETA: 0s - loss: 0.0876 - accuracy: 0.9623
70/80 [=========================>....] - ETA: 0s - loss: 0.0913 - accuracy: 0.9597
79/80 [============================>.] - ETA: 0s - loss: 0.0932 - accuracy: 0.9586
80/80 [==============================] - 0s 5ms/step - loss: 0.0934 - accuracy: 0.9585

80/80 [==============================] - 1s 7ms/step - loss: 0.0934 - accuracy: 0.9585 - val_loss: 0.8992 - val_accuracy: 0.8120

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-01T18-52-54Z

runs

Data frame: 8 x 25 

# ... with 20 more columns:
#   flag_nodes, flag_batch_size, flag_activation, flag_learning_rate, flag_epochs,
#   epochs, epochs_completed, metrics, model, loss_function, optimizer,
#   learning_rate, script, start, end, completed, output, source_code, context, type

1. The model with the best validation accuracy was the model from the first run
2. see attached for plot of best training run
3. the validation error stops decreasing after the 13th epoch

Q3. (5 pts) Now use ALL the training data in reuters$train (i.e., train + validation data) to train an ANN with the best hyper- parameter combination you found after tuning in the previous question. Compute the accuracy of this model on the test set.

reuters_train = one_hot_encoding(reuters$train$x)
reuters_test = one_hot_encoding(reuters$test$x)

model <- keras_model_sequential()
model %>%
        layer_dense( units = 128, activation = "tanh", input_shape = 10000) %>%
        layer_dense( units = 128, activation = "tanh") %>%
        layer_dense( units = 128, activation = "tanh") %>%
        layer_dense(units = 46, activation = 'softmax')

set.seed(123)
model %>% compile (
        loss = 'sparse_categorical_crossentropy',
        optimizer = optimizer_adam(lr=0.0001),
        metrics = 'accuracy')

model %>% fit (x = reuters_train, y = reuters$train$y, epochs = 30, batch_size = 100)

Epoch 1/30

 1/90 [..............................] - ETA: 0s - loss: 3.8511 - accuracy: 0.0100
11/90 [==>...........................] - ETA: 0s - loss: 3.7027 - accuracy: 0.2064
21/90 [======>.......................] - ETA: 0s - loss: 3.5659 - accuracy: 0.3281
31/90 [=========>....................] - ETA: 0s - loss: 3.4325 - accuracy: 0.3739
41/90 [============>.................] - ETA: 0s - loss: 3.2871 - accuracy: 0.4071
51/90 [================>.............] - ETA: 0s - loss: 3.1483 - accuracy: 0.4273
61/90 [===================>..........] - ETA: 0s - loss: 3.0159 - accuracy: 0.4420
71/90 [======================>.......] - ETA: 0s - loss: 2.9037 - accuracy: 0.4527
81/90 [==========================>...] - ETA: 0s - loss: 2.7945 - accuracy: 0.4644
90/90 [==============================] - 0s 5ms/step - loss: 2.7101 - accuracy: 0.4718

90/90 [==============================] - 1s 11ms/step - loss: 2.7101 - accuracy: 0.4718
Epoch 2/30

 1/90 [..............................] - ETA: 0s - loss: 2.0860 - accuracy: 0.4900
11/90 [==>...........................] - ETA: 0s - loss: 1.9065 - accuracy: 0.5373
21/90 [======>.......................] - ETA: 0s - loss: 1.8303 - accuracy: 0.5681
31/90 [=========>....................] - ETA: 0s - loss: 1.7701 - accuracy: 0.5903
41/90 [============>.................] - ETA: 0s - loss: 1.7145 - accuracy: 0.6120
51/90 [================>.............] - ETA: 0s - loss: 1.6849 - accuracy: 0.6235
61/90 [===================>..........] - ETA: 0s - loss: 1.6637 - accuracy: 0.6293
71/90 [======================>.......] - ETA: 0s - loss: 1.6503 - accuracy: 0.6330
81/90 [==========================>...] - ETA: 0s - loss: 1.6281 - accuracy: 0.6390
90/90 [==============================] - 0s 5ms/step - loss: 1.6166 - accuracy: 0.6418

90/90 [==============================] - 1s 6ms/step - loss: 1.6166 - accuracy: 0.6418
Epoch 3/30

 1/90 [..............................] - ETA: 0s - loss: 1.2606 - accuracy: 0.7400
11/90 [==>...........................] - ETA: 0s - loss: 1.4130 - accuracy: 0.6900
21/90 [======>.......................] - ETA: 0s - loss: 1.4059 - accuracy: 0.6848
31/90 [=========>....................] - ETA: 0s - loss: 1.3615 - accuracy: 0.6955
41/90 [============>.................] - ETA: 0s - loss: 1.3425 - accuracy: 0.7015
51/90 [================>.............] - ETA: 0s - loss: 1.3219 - accuracy: 0.7067

history = model %>% fit (x = reuters_train, y = reuters$train$y)

Epoch 1/10

  1/281 [..............................] - ETA: 0s - loss: 0.0809 - accuracy: 0.9375
 17/281 [>.............................] - ETA: 0s - loss: 0.0758 - accuracy: 0.9688
 33/281 [==>...........................] - ETA: 0s - loss: 0.0872 - accuracy: 0.9669
 50/281 [====>.........................] - ETA: 0s - loss: 0.0920 - accuracy: 0.9656
 66/281 [======>.......................] - ETA: 0s - loss: 0.0911 - accuracy: 0.9669
 83/281 [=======>......................] - ETA: 0s - loss: 0.0955 - accuracy: 0.9646
100/281 [=========>....................] - ETA: 0s - loss: 0.0971 - accuracy: 0.9638
116/281 [===========>..................] - ETA: 0s - loss: 0.0990 - accuracy: 0.9639
133/281 [=============>................] - ETA: 0s - loss: 0.1046 - accuracy: 0.9626
150/281 [===============>..............] - ETA: 0s - loss: 0.1073 - accuracy: 0.9619
167/281 [================>.............] - ETA: 0s - loss: 0.1093 - accuracy: 0.9615
184/281 [==================>...........] - ETA: 0s - loss: 0.1216 - accuracy: 0.9577
200/281 [====================>.........] - ETA: 0s - loss: 0.1261 - accuracy: 0.9572
217/281 [======================>.......] - ETA: 0s - loss: 0.1278 - accuracy: 0.9569
233/281 [=======================>......] - ETA: 0s - loss: 0.1293 - accuracy: 0.9565
249/281 [=========================>....] - ETA: 0s - loss: 0.1322 - accuracy: 0.9552
266/281 [===========================>..] - ETA: 0s - loss: 0.1332 - accuracy: 0.9547
281/281 [==============================] - 1s 3ms/step - loss: 0.1356 - accuracy: 0.9538

281/281 [==============================] - 1s 5ms/step - loss: 0.1356 - accuracy: 0.9538
Epoch 2/10

  1/281 [..............................] - ETA: 0s - loss: 0.0468 - accuracy: 1.0000
 17/281 [>.............................] - ETA: 0s - loss: 0.0803 - accuracy: 0.9688
 33/281 [==>...........................] - ETA: 0s - loss: 0.0853 - accuracy: 0.9669
 50/281 [====>.........................] - ETA: 0s - loss: 0.0815 - accuracy: 0.9694
 67/281 [======>.......................] - ETA: 0s - loss: 0.0889 - accuracy: 0.9678
 84/281 [=======>......................] - ETA: 0s - loss: 0.0930 - accuracy: 0.9661
100/281 [=========>....................] - ETA: 0s - loss: 0.0906 - accuracy: 0.9669
117/281 [===========>..................] - ETA: 0s - loss: 0.0967 - accuracy: 0.9650
134/281 [=============>................] - ETA: 0s - loss: 0.0978 - accuracy: 0.9643
150/281 [===============>..............] - ETA: 0s - loss: 0.1014 - accuracy: 0.9625
166/281 [================>.............] - ETA: 0s - loss: 0.1038 - accuracy: 0.9608
180/281 [==================>...........] - ETA: 0s - loss: 0.1097 - accuracy: 0.9582
197/281 [====================>.........] - ETA: 0s - loss: 0.1116 - accuracy: 0.9569
214/281 [=====================>........] - ETA: 0s - loss: 0.1126 - accuracy: 0.9559
230/281 [=======================>......] - ETA: 0s - loss: 0.1137 - accuracy: 0.9554
247/281 [=========================>....] - ETA: 0s - loss: 0.1155 - accuracy: 0.9547
264/281 [===========================>..] - ETA: 0s - loss: 0.1157 - accuracy: 0.9547
280/281 [============================>.] - ETA: 0s - loss: 0.1168 - accuracy: 0.9542
281/281 [==============================] - 1s 3ms/step - loss: 0.1168 - accuracy: 0.9542

281/281 [==============================] - 1s 4ms/step - loss: 0.1168 - accuracy: 0.9542
Epoch 3/10

  1/281 [..............................] - ETA: 0s - loss: 0.0835 - accuracy: 0.9375
 17/281 [>.............................] - ETA: 0s - loss: 0.0675 - accuracy: 0.9706
 32/281 [==>...........................] - ETA: 0s - loss: 0.0733 - accuracy: 0.9697
 48/281 [====>.........................] - ETA: 0s - loss: 0.0724 - accuracy: 0.9688
 64/281 [=====>........................] - ETA: 0s - loss: 0.0764 - accuracy: 0.9692
 80/281 [=======>......................] - ETA: 0s - loss: 0.0827 - accuracy: 0.9664
 96/281 [=========>....................] - ETA: 0s - loss: 0.0888 - accuracy: 0.9629
111/281 [==========>...................] - ETA: 0s - loss: 0.0898 - accuracy: 0.9620
126/281 [============>.................] - ETA: 0s - loss: 0.0914 - accuracy: 0.9613
141/281 [==============>...............] - ETA: 0s - loss: 0.0950 - accuracy: 0.9594
157/281 [===============>..............] - ETA: 0s - loss: 0.0954 - accuracy: 0.9594
172/281 [=================>............] - ETA: 0s - loss: 0.0986 - accuracy: 0.9578
187/281 [==================>...........] - ETA: 0s - loss: 0.0976 - accuracy: 0.9587
202/281 [====================>.........] - ETA: 0s - loss: 0.0993 - accuracy: 0.9576
217/281 [======================>.......] - ETA: 0s - loss: 0.1035 - accuracy: 0.9555
232/281 [=======================>......] - ETA: 0s - loss: 0.1048 - accuracy: 0.9549
248/281 [=========================>....] - ETA: 0s - loss: 0.1057 - accuracy: 0.9545
264/281 [===========================>..] - ETA: 0s - loss: 0.1066 - accuracy: 0.9542
280/281 [============================>.] - ETA: 0s - loss: 0.1075 - accuracy: 0.9541
281/281 [==============================] - 1s 3ms/step - loss: 0.1074 - accuracy: 0.9541

281/281 [==============================] - 1s 4ms/step - loss: 0.1074 - accuracy: 0.9541
Epoch 4/10

  1/281 [..............................] - ETA: 0s - loss: 0.0143 - accuracy: 1.0000
 19/281 [=>............................] - ETA: 0s - loss: 0.0711 - accuracy: 0.9688
 35/281 [==>...........................] - ETA: 0s - loss: 0.0729 - accuracy: 0.9679
 52/281 [====>.........................] - ETA: 0s - loss: 0.0781 - accuracy: 0.9663
 68/281 [======>.......................] - ETA: 0s - loss: 0.0797 - accuracy: 0.9669
 85/281 [========>.....................] - ETA: 0s - loss: 0.0778 - accuracy: 0.9665
102/281 [=========>....................] - ETA: 0s - loss: 0.0801 - accuracy: 0.9645
119/281 [===========>..................] - ETA: 0s - loss: 0.0831 - accuracy: 0.9624
136/281 [=============>................] - ETA: 0s - loss: 0.0854 - accuracy: 0.9619
153/281 [===============>..............] - ETA: 0s - loss: 0.0865 - accuracy: 0.9618
169/281 [=================>............] - ETA: 0s - loss: 0.0880 - accuracy: 0.9614
186/281 [==================>...........] - ETA: 0s - loss: 0.0911 - accuracy: 0.9593
203/281 [====================>.........] - ETA: 0s - loss: 0.0955 - accuracy: 0.9572
218/281 [======================>.......] - ETA: 0s - loss: 0.0970 - accuracy: 0.9561
234/281 [=======================>......] - ETA: 0s - loss: 0.0968 - accuracy: 0.9562
250/281 [=========================>....] - ETA: 0s - loss: 0.0971 - accuracy: 0.9563
267/281 [===========================>..] - ETA: 0s - loss: 0.0982 - accuracy: 0.9555
281/281 [==============================] - 1s 3ms/step - loss: 0.1005 - accuracy: 0.9544

281/281 [==============================] - 1s 4ms/step - loss: 0.1005 - accuracy: 0.9544
Epoch 5/10

  1/281 [..............................] - ETA: 0s - loss: 0.0848 - accuracy: 0.9688
 17/281 [>.............................] - ETA: 0s - loss: 0.0691 - accuracy: 0.9724
 34/281 [==>...........................] - ETA: 0s - loss: 0.0891 - accuracy: 0.9651
 50/281 [====>.........................] - ETA: 0s - loss: 0.0842 - accuracy: 0.9650
 67/281 [======>.......................] - ETA: 0s - loss: 0.0834 - accuracy: 0.9632
 84/281 [=======>......................] - ETA: 0s - loss: 0.0804 - accuracy: 0.9654
100/281 [=========>....................] - ETA: 0s - loss: 0.0807 - accuracy: 0.9644
117/281 [===========>..................] - ETA: 0s - loss: 0.0827 - accuracy: 0.9637
134/281 [=============>................] - ETA: 0s - loss: 0.0831 - accuracy: 0.9634
150/281 [===============>..............] - ETA: 0s - loss: 0.0832 - accuracy: 0.9638
167/281 [================>.............] - ETA: 0s - loss: 0.0844 - accuracy: 0.9626
184/281 [==================>...........] - ETA: 0s - loss: 0.0861 - accuracy: 0.9618
200/281 [====================>.........] - ETA: 0s - loss: 0.0906 - accuracy: 0.9594
216/281 [======================>.......] - ETA: 0s - loss: 0.0913 - accuracy: 0.9582
233/281 [=======================>......] - ETA: 0s - loss: 0.0952 - accuracy: 0.9556
249/281 [=========================>....] - ETA: 0s - loss: 0.0968 - accuracy: 0.9549
264/281 [===========================>..] - ETA: 0s - loss: 0.0989 - accuracy: 0.9534
281/281 [==============================] - 1s 3ms/step - loss: 0.0983 - accuracy: 0.9537

281/281 [==============================] - 1s 3ms/step - loss: 0.0983 - accuracy: 0.9537
Epoch 6/10

  1/281 [..............................] - ETA: 0s - loss: 0.0694 - accuracy: 0.9688
 17/281 [>.............................] - ETA: 0s - loss: 0.0826 - accuracy: 0.9632
 33/281 [==>...........................] - ETA: 0s - loss: 0.0815 - accuracy: 0.9621
 49/281 [====>.........................] - ETA: 0s - loss: 0.0798 - accuracy: 0.9643
 66/281 [======>.......................] - ETA: 0s - loss: 0.0770 - accuracy: 0.9645
 83/281 [=======>......................] - ETA: 0s - loss: 0.0777 - accuracy: 0.9639
 99/281 [=========>....................] - ETA: 0s - loss: 0.0766 - accuracy: 0.9653
116/281 [===========>..................] - ETA: 0s - loss: 0.0752 - accuracy: 0.9658
132/281 [=============>................] - ETA: 0s - loss: 0.0803 - accuracy: 0.9626
148/281 [==============>...............] - ETA: 0s - loss: 0.0848 - accuracy: 0.9597
164/281 [================>.............] - ETA: 0s - loss: 0.0852 - accuracy: 0.9594
180/281 [==================>...........] - ETA: 0s - loss: 0.0867 - accuracy: 0.9585
197/281 [====================>.........] - ETA: 0s - loss: 0.0880 - accuracy: 0.9572
213/281 [=====================>........] - ETA: 0s - loss: 0.0895 - accuracy: 0.9564
229/281 [=======================>......] - ETA: 0s - loss: 0.0920 - accuracy: 0.9556
245/281 [=========================>....] - ETA: 0s - loss: 0.0923 - accuracy: 0.9551
261/281 [==========================>...] - ETA: 0s - loss: 0.0932 - accuracy: 0.9547
277/281 [============================>.] - ETA: 0s - loss: 0.0942 - accuracy: 0.9543
281/281 [==============================] - 1s 3ms/step - loss: 0.0937 - accuracy: 0.9546

281/281 [==============================] - 1s 4ms/step - loss: 0.0937 - accuracy: 0.9546
Epoch 7/10

  1/281 [..............................] - ETA: 0s - loss: 0.0548 - accuracy: 0.9688
 17/281 [>.............................] - ETA: 0s - loss: 0.0780 - accuracy: 0.9577
 33/281 [==>...........................] - ETA: 0s - loss: 0.0726 - accuracy: 0.9621
 50/281 [====>.........................] - ETA: 0s - loss: 0.0748 - accuracy: 0.9594
 66/281 [======>.......................] - ETA: 0s - loss: 0.0709 - accuracy: 0.9616
 83/281 [=======>......................] - ETA: 0s - loss: 0.0706 - accuracy: 0.9627
 99/281 [=========>....................] - ETA: 0s - loss: 0.0691 - accuracy: 0.9634
115/281 [===========>..................] - ETA: 0s - loss: 0.0721 - accuracy: 0.9609
132/281 [=============>................] - ETA: 0s - loss: 0.0760 - accuracy: 0.9588
149/281 [==============>...............] - ETA: 0s - loss: 0.0780 - accuracy: 0.9583
166/281 [================>.............] - ETA: 0s - loss: 0.0795 - accuracy: 0.9576
182/281 [==================>...........] - ETA: 0s - loss: 0.0820 - accuracy: 0.9560
198/281 [====================>.........] - ETA: 0s - loss: 0.0828 - accuracy: 0.9560
215/281 [=====================>........] - ETA: 0s - loss: 0.0847 - accuracy: 0.9548
232/281 [=======================>......] - ETA: 0s - loss: 0.0877 - accuracy: 0.9534
248/281 [=========================>....] - ETA: 0s - loss: 0.0881 - accuracy: 0.9530
265/281 [===========================>..] - ETA: 0s - loss: 0.0901 - accuracy: 0.9519
281/281 [==============================] - 1s 3ms/step - loss: 0.0917 - accuracy: 0.9510

281/281 [==============================] - 1s 4ms/step - loss: 0.0917 - accuracy: 0.9510
Epoch 8/10

  1/281 [..............................] - ETA: 0s - loss: 0.0450 - accuracy: 1.0000
 17/281 [>.............................] - ETA: 0s - loss: 0.0574 - accuracy: 0.9706
 33/281 [==>...........................] - ETA: 0s - loss: 0.0684 - accuracy: 0.9650
 49/281 [====>.........................] - ETA: 0s - loss: 0.0707 - accuracy: 0.9636
 65/281 [=====>........................] - ETA: 0s - loss: 0.0753 - accuracy: 0.9615
 81/281 [=======>......................] - ETA: 0s - loss: 0.0752 - accuracy: 0.9618
 98/281 [=========>....................] - ETA: 0s - loss: 0.0794 - accuracy: 0.9598
115/281 [===========>..................] - ETA: 0s - loss: 0.0786 - accuracy: 0.9598
131/281 [============>.................] - ETA: 0s - loss: 0.0789 - accuracy: 0.9599
148/281 [==============>...............] - ETA: 0s - loss: 0.0788 - accuracy: 0.9599
163/281 [================>.............] - ETA: 0s - loss: 0.0802 - accuracy: 0.9584
180/281 [==================>...........] - ETA: 0s - loss: 0.0816 - accuracy: 0.9575
196/281 [===================>..........] - ETA: 0s - loss: 0.0822 - accuracy: 0.9573
213/281 [=====================>........] - ETA: 0s - loss: 0.0834 - accuracy: 0.9566
229/281 [=======================>......] - ETA: 0s - loss: 0.0844 - accuracy: 0.9559
247/281 [=========================>....] - ETA: 0s - loss: 0.0862 - accuracy: 0.9553
263/281 [===========================>..] - ETA: 0s - loss: 0.0876 - accuracy: 0.9550
280/281 [============================>.] - ETA: 0s - loss: 0.0892 - accuracy: 0.9542
281/281 [==============================] - 1s 3ms/step - loss: 0.0895 - accuracy: 0.9541

281/281 [==============================] - 1s 4ms/step - loss: 0.0895 - accuracy: 0.9541
Epoch 9/10

  1/281 [..............................] - ETA: 0s - loss: 0.0422 - accuracy: 1.0000
 18/281 [>.............................] - ETA: 0s - loss: 0.0723 - accuracy: 0.9740
 34/281 [==>...........................] - ETA: 0s - loss: 0.0693 - accuracy: 0.9733
 50/281 [====>.........................] - ETA: 0s - loss: 0.0615 - accuracy: 0.9756
 65/281 [=====>........................] - ETA: 0s - loss: 0.0717 - accuracy: 0.9668
 80/281 [=======>......................] - ETA: 0s - loss: 0.0679 - accuracy: 0.9684
 96/281 [=========>....................] - ETA: 0s - loss: 0.0687 - accuracy: 0.9678
113/281 [===========>..................] - ETA: 0s - loss: 0.0688 - accuracy: 0.9676
130/281 [============>.................] - ETA: 0s - loss: 0.0692 - accuracy: 0.9668
146/281 [==============>...............] - ETA: 0s - loss: 0.0690 - accuracy: 0.9670
162/281 [================>.............] - ETA: 0s - loss: 0.0703 - accuracy: 0.9660
178/281 [==================>...........] - ETA: 0s - loss: 0.0736 - accuracy: 0.9645
194/281 [===================>..........] - ETA: 0s - loss: 0.0766 - accuracy: 0.9625
211/281 [=====================>........] - ETA: 0s - loss: 0.0794 - accuracy: 0.9606
227/281 [=======================>......] - ETA: 0s - loss: 0.0822 - accuracy: 0.9593
243/281 [========================>.....] - ETA: 0s - loss: 0.0846 - accuracy: 0.9578
259/281 [==========================>...] - ETA: 0s - loss: 0.0861 - accuracy: 0.9564
275/281 [============================>.] - ETA: 0s - loss: 0.0878 - accuracy: 0.9552
281/281 [==============================] - 1s 3ms/step - loss: 0.0876 - accuracy: 0.9554

281/281 [==============================] - 1s 4ms/step - loss: 0.0876 - accuracy: 0.9554
Epoch 10/10

  1/281 [..............................] - ETA: 0s - loss: 0.0703 - accuracy: 0.9688
 17/281 [>.............................] - ETA: 0s - loss: 0.0560 - accuracy: 0.9779
 33/281 [==>...........................] - ETA: 0s - loss: 0.0550 - accuracy: 0.9763
 49/281 [====>.........................] - ETA: 0s - loss: 0.0579 - accuracy: 0.9726
 64/281 [=====>........................] - ETA: 0s - loss: 0.0644 - accuracy: 0.9688
 76/281 [=======>......................] - ETA: 0s - loss: 0.0653 - accuracy: 0.9671
 90/281 [========>.....................] - ETA: 0s - loss: 0.0647 - accuracy: 0.9667
105/281 [==========>...................] - ETA: 0s - loss: 0.0685 - accuracy: 0.9634
118/281 [===========>..................] - ETA: 0s - loss: 0.0684 - accuracy: 0.9632
133/281 [=============>................] - ETA: 0s - loss: 0.0690 - accuracy: 0.9629
148/281 [==============>...............] - ETA: 0s - loss: 0.0731 - accuracy: 0.9601
163/281 [================>.............] - ETA: 0s - loss: 0.0737 - accuracy: 0.9595
177/281 [=================>............] - ETA: 0s - loss: 0.0758 - accuracy: 0.9580
191/281 [===================>..........] - ETA: 0s - loss: 0.0772 - accuracy: 0.9580
206/281 [====================>.........] - ETA: 0s - loss: 0.0797 - accuracy: 0.9568
221/281 [======================>.......] - ETA: 0s - loss: 0.0802 - accuracy: 0.9567
235/281 [========================>.....] - ETA: 0s - loss: 0.0814 - accuracy: 0.9561
251/281 [=========================>....] - ETA: 0s - loss: 0.0832 - accuracy: 0.9557
266/281 [===========================>..] - ETA: 0s - loss: 0.0855 - accuracy: 0.9545
281/281 [==============================] - 1s 4ms/step - loss: 0.0854 - accuracy: 0.9546

281/281 [==============================] - 1s 4ms/step - loss: 0.0854 - accuracy: 0.9546

history

Final epoch (plot to see history):
    loss: 0.08542
accuracy: 0.9546 

Problem2——Predicting Baseball players’ salaries

1. (1p) Download the dataset hitters.csv and explore the overall structure of the dataset using the str() function. Get a summary statistics of each variable. Answer the following questions:

1. How many observations do you have in the data?
2. How many categorical and numeric variables you have in your data?
3. Is there any missing value?
4. Draw the histogram of salary. Interpret what you see in the histogram.

hitters = read.csv("hitters.csv")

str(hitters)

'data.frame':   322 obs. of  20 variables:
 $ AtBat    : int  293 315 479 496 321 594 185 298 323 401 ...
 $ Hits     : int  66 81 130 141 87 169 37 73 81 92 ...
 $ HmRun    : int  1 7 18 20 10 4 1 0 6 17 ...
 $ Runs     : int  30 24 66 65 39 74 23 24 26 49 ...
 $ RBI      : int  29 38 72 78 42 51 8 24 32 66 ...
 $ Walks    : int  14 39 76 37 30 35 21 7 8 65 ...
 $ Years    : int  1 14 3 11 2 11 2 3 2 13 ...
 $ CAtBat   : int  293 3449 1624 5628 396 4408 214 509 341 5206 ...
 $ CHits    : int  66 835 457 1575 101 1133 42 108 86 1332 ...
 $ CHmRun   : int  1 69 63 225 12 19 1 0 6 253 ...
 $ CRuns    : int  30 321 224 828 48 501 30 41 32 784 ...
 $ CRBI     : int  29 414 266 838 46 336 9 37 34 890 ...
 $ CWalks   : int  14 375 263 354 33 194 24 12 8 866 ...
 $ League   : chr  "A" "N" "A" "N" ...
 $ Division : chr  "E" "W" "W" "E" ...
 $ PutOuts  : int  446 632 880 200 805 282 76 121 143 0 ...
 $ Assists  : int  33 43 82 11 40 421 127 283 290 0 ...
 $ Errors   : int  20 10 14 3 4 25 7 9 19 0 ...
 $ Salary   : num  NA 475 480 500 91.5 750 70 100 75 1100 ...
 $ NewLeague: chr  "A" "N" "A" "N" ...

summary(hitters)

     AtBat            Hits         HmRun            Runs             RBI        
 Min.   : 16.0   Min.   :  1   Min.   : 0.00   Min.   :  0.00   Min.   :  0.00  
 1st Qu.:255.2   1st Qu.: 64   1st Qu.: 4.00   1st Qu.: 30.25   1st Qu.: 28.00  
 Median :379.5   Median : 96   Median : 8.00   Median : 48.00   Median : 44.00  
 Mean   :380.9   Mean   :101   Mean   :10.77   Mean   : 50.91   Mean   : 48.03  
 3rd Qu.:512.0   3rd Qu.:137   3rd Qu.:16.00   3rd Qu.: 69.00   3rd Qu.: 64.75  
 Max.   :687.0   Max.   :238   Max.   :40.00   Max.   :130.00   Max.   :121.00  
                                                                                
     Walks            Years            CAtBat            CHits            CHmRun      
 Min.   :  0.00   Min.   : 1.000   Min.   :   19.0   Min.   :   4.0   Min.   :  0.00  
 1st Qu.: 22.00   1st Qu.: 4.000   1st Qu.:  816.8   1st Qu.: 209.0   1st Qu.: 14.00  
 Median : 35.00   Median : 6.000   Median : 1928.0   Median : 508.0   Median : 37.50  
 Mean   : 38.74   Mean   : 7.444   Mean   : 2648.7   Mean   : 717.6   Mean   : 69.49  
 3rd Qu.: 53.00   3rd Qu.:11.000   3rd Qu.: 3924.2   3rd Qu.:1059.2   3rd Qu.: 90.00  
 Max.   :105.00   Max.   :24.000   Max.   :14053.0   Max.   :4256.0   Max.   :548.00  
                                                                                      
     CRuns             CRBI             CWalks           League            Division        
 Min.   :   1.0   Min.   :   0.00   Min.   :   0.00   Length:322         Length:322        
 1st Qu.: 100.2   1st Qu.:  88.75   1st Qu.:  67.25   Class :character   Class :character  
 Median : 247.0   Median : 220.50   Median : 170.50   Mode  :character   Mode  :character  
 Mean   : 358.8   Mean   : 330.12   Mean   : 260.24                                        
 3rd Qu.: 526.2   3rd Qu.: 426.25   3rd Qu.: 339.25                                        
 Max.   :2165.0   Max.   :1659.00   Max.   :1566.00                                        
                                                                                           
    PutOuts          Assists          Errors          Salary        NewLeague        
 Min.   :   0.0   Min.   :  0.0   Min.   : 0.00   Min.   :  67.5   Length:322        
 1st Qu.: 109.2   1st Qu.:  7.0   1st Qu.: 3.00   1st Qu.: 190.0   Class :character  
 Median : 212.0   Median : 39.5   Median : 6.00   Median : 425.0   Mode  :character  
 Mean   : 288.9   Mean   :106.9   Mean   : 8.04   Mean   : 535.9                     
 3rd Qu.: 325.0   3rd Qu.:166.0   3rd Qu.:11.00   3rd Qu.: 750.0                     
 Max.   :1378.0   Max.   :492.0   Max.   :32.00   Max.   :2460.0                     
                                                  NA's   :59                         

1. There are 322 observations
2. There are 3 categorical variables and 17 numeric variables
3. There are 59 missing values in salary
4. The histogram is skewed right and the mean is around 500

hist(hitters$Salary)

2. (1p) remove the observation for which Salary value is missing

hitters_clean = hitters[!is.na(hitters$Salary),]

3. (2 pt) Which predictors have most correlation with Salary? Use scattered plot, side-by-side box plots, t-test and correlation matrix to answer this question.

plot(hitters_clean[ , c(19, 1:4)])

plot(hitters_clean[ , c(19, 5:9)])

plot(hitters_clean[ , c(19, 10:13)])

plot(hitters_clean[ , c(19, 16:18)])

boxplot(Salary~League,data = hitters_clean)

boxplot(Salary~Division,data = hitters_clean)

boxplot(Salary~NewLeague,data = hitters_clean)

t.test(Salary~League, data = hitters_clean)

    Welch Two Sample t-test

data:  Salary by League
t = 0.23157, df = 260.26, p-value = 0.8171
alternative hypothesis: true difference in means is not equal to 0
95 percent confidence interval:
 -96.66039 122.42448
sample estimates:
mean in group A mean in group N 
       541.9995        529.1175 

t.test(Salary~Division,data = hitters_clean)

    Welch Two Sample t-test

data:  Salary by Division
t = 3.145, df = 218.46, p-value = 0.001892
alternative hypothesis: true difference in means is not equal to 0
95 percent confidence interval:
  64.73206 282.05692
sample estimates:
mean in group E mean in group W 
       624.2714        450.8769 

t.test(Salary~NewLeague,data = hitters_clean)

    Welch Two Sample t-test

data:  Salary by NewLeague
t = 0.045921, df = 258.07, p-value = 0.9634
alternative hypothesis: true difference in means is not equal to 0
95 percent confidence interval:
 -107.1832  112.3016
sample estimates:
mean in group A mean in group N 
       537.1130        534.5539 

cor(hitters_clean$Salary, y=hitters_clean[-c(19, 15, 14, 20)])

         AtBat      Hits     HmRun      Runs       RBI     Walks    Years    CAtBat
[1,] 0.3947709 0.4386747 0.3430281 0.4198586 0.4494571 0.4438673 0.400657 0.5261353
         CHits    CHmRun     CRuns      CRBI   CWalks   PutOuts    Assists       Errors
[1,] 0.5489096 0.5249306 0.5626777 0.5669657 0.489822 0.3004804 0.02543614 -0.005400702

CAtBat, CHits, CHmRun, CRuns, and CRBI have correlations greater than .5

4. Use set.seed(1) to set the random seed so I can reproduce your results.

set.seed(1)

5. Use Caret’s “createDataPartition” method as follows to partition the dataset into hitters_train, and hitters_test (use 90% for training and 10% for testing)

inTrain = createDataPartition(hitters_clean$Salary, p=0.9, list=FALSE)
hitters_train = hitters_clean[inTrain,]
hitters_test = hitters_clean[-inTrain,]

6. (1pt) Neural networks do not accept categorical variables and we must encode the categorical variables before training the network. All the categorical variables in this dataset are binary ( i.e., have two levels) so you can encode them by simply using iflese function to convert each to a numeric variable with two values 0 and 1.

hitters_train$NewLeague = ifelse(hitters_train$NewLeague == "N", 1, 0)
hitters_train$Division = ifelse(hitters_train$Division == "W", 1, 0)
hitters_train$League = ifelse(hitters_train$League == "N", 1, 0)

7. (1pt)Replace the salary column with log(salary) where log is the logarithm function. This will be the attribute we want to predict.

hitters_train$Salary = log(hitters_train$Salary)

8. (1pt) Set.seed(1) and further divide the hitters_train data into 90% training and 10% validation using Caret’s “CreateDataPartition” function

toTrain = createDataPartition(hitters_train$Salary, p=0.9, list=FALSE)
hitters_train = hitters_train[toTrain , ]
hitters_val = hitters_train[-toTrain , ]

9. ( 3 pt) Scale the numeric attributes in the training data (except for the outcome variable, Salary). Use the column means and column standard deviations from the training data to scale both the validation and test data (please refer to slide 81, lecture 9). Note: You should not scale the dummy variables you created in step 6. You can append the categorical variables to your scaled numeric variables.

hitters_scale_train = scale(hitters_train[-c(14,15,20,19)])

hitters_mean_train = attr(hitters_scale_train, "scaled:center")
hitters_stddevs_train = attr(hitters_scale_train, "scaled:scale")

hitters_scale_train = as.data.frame(hitters_scale_train)
hitters_train_labels = hitters_train[,19]
hitters_scale_train$Salary = NULL

hitters_scale_train$League = hitters_train[,14]
hitters_scale_train$Division = hitters_train[,15]
hitters_scale_train$NewLeague = hitters_train[,20]

hitters_scale_val = as.data.frame(scale(hitters_val[-c(14,15,20,19)], center = hitters_mean_train, scale = hitters_stddevs_train))
hitters_val_labels = hitters_val[,19]
hitters_scale_val$Salary = NULL
hitters_scale_val$League = hitters_val[,14]
hitters_scale_val$Division = hitters_val[,15]
hitters_scale_val$NewLeague = hitters_val[,20]

hitters_scale_test = as.data.frame(scale(hitters_test[-c(14,15,20,19)], center = hitters_mean_train, scale = hitters_stddevs_train))
hitters_test_labels = hitters_test[,19]
hitters_scale_test$Salary = NULL
hitters_scale_test$League = hitters_test[,14]
hitters_scale_test$Division = hitters_test[,15]
hitters_scale_test$NewLeague = hitters_test[,20]

9 cont. (5 pt) Create an ANN model to predict log(salary) from other attributes. Use at least two hidden layers. Use tfruns to tune your model’s hyper-parameters including, the number of nodes in each hidden layer, the activation function in each hidden layer, batch_size, learning_rate, and the number of epochs). Validate each model on the validation set. Answer the following questions:

library(tfruns)

runs <- tuning_run("hitters.R",
                   flags = list (
                     nodes = c(64, 128, 392),
                     learning_rate = c(0.01, 0.05, 0.001, 0.0001),
                     batch_size = c(100, 200, 500, 1000),
                     epochs = c(30, 50, 100),
                     activation = c("relu","sigmoid","tanh")
                   ), sample = 0.02)

432 total combinations of flags (sampled to 8 combinations)

y

Training run 1/8 (flags = list(392, 1e-04, 500, 30, "tanh")) 
Using run directory runs/2020-11-02T19-38-41Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = dim(hitters_scale_train)[2]) %>%
+         layer_ .... [TRUNCATED] 

> set.seed(1)

> model %>% compile (
+         loss = 'mse',
+         optimizer = optimizer_sgd(lr=FLAGS$learning_rate))

> model %>% fit (x = as.matrix(hitters_scale_train), y = hitters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = .... [TRUNCATED] 
Epoch 1/30

1/1 [==============================] - 0s 12us/step - loss: 34.4054

1/1 [==============================] - 1s 581ms/step - loss: 34.4054 - val_loss: 35.5684
Epoch 2/30

1/1 [==============================] - 0s 14us/step - loss: 34.2553

1/1 [==============================] - 0s 140ms/step - loss: 34.2553 - val_loss: 35.4413
Epoch 3/30

1/1 [==============================] - 0s 14us/step - loss: 34.1059

1/1 [==============================] - 0s 134ms/step - loss: 34.1059 - val_loss: 35.3146
Epoch 4/30

1/1 [==============================] - 0s 13us/step - loss: 33.9570

1/1 [==============================] - 0s 136ms/step - loss: 33.9570 - val_loss: 35.1884
Epoch 5/30

1/1 [==============================] - 0s 13us/step - loss: 33.8087

1/1 [==============================] - 0s 137ms/step - loss: 33.8087 - val_loss: 35.0625
Epoch 6/30

1/1 [==============================] - 0s 14us/step - loss: 33.6610

1/1 [==============================] - 0s 137ms/step - loss: 33.6610 - val_loss: 34.9370
Epoch 7/30

1/1 [==============================] - 0s 11us/step - loss: 33.5138

1/1 [==============================] - 0s 136ms/step - loss: 33.5138 - val_loss: 34.8119
Epoch 8/30

1/1 [==============================] - 0s 11us/step - loss: 33.3672

1/1 [==============================] - 0s 133ms/step - loss: 33.3672 - val_loss: 34.6872
Epoch 9/30

1/1 [==============================] - 0s 15us/step - loss: 33.2211

1/1 [==============================] - 0s 135ms/step - loss: 33.2211 - val_loss: 34.5628
Epoch 10/30

1/1 [==============================] - 0s 14us/step - loss: 33.0755

1/1 [==============================] - 0s 135ms/step - loss: 33.0755 - val_loss: 34.4387
Epoch 11/30

1/1 [==============================] - 0s 13us/step - loss: 32.9305

1/1 [==============================] - 0s 143ms/step - loss: 32.9305 - val_loss: 34.3151
Epoch 12/30

1/1 [==============================] - 0s 13us/step - loss: 32.7860

1/1 [==============================] - 0s 253ms/step - loss: 32.7860 - val_loss: 34.1917
Epoch 13/30

1/1 [==============================] - 0s 13us/step - loss: 32.6419

1/1 [==============================] - 0s 134ms/step - loss: 32.6419 - val_loss: 34.0687
Epoch 14/30

1/1 [==============================] - 0s 14us/step - loss: 32.4984

1/1 [==============================] - 0s 133ms/step - loss: 32.4984 - val_loss: 33.9460
Epoch 15/30

1/1 [==============================] - 0s 12us/step - loss: 32.3553

1/1 [==============================] - 0s 135ms/step - loss: 32.3553 - val_loss: 33.8236
Epoch 16/30

1/1 [==============================] - 0s 15us/step - loss: 32.2127

1/1 [==============================] - 0s 137ms/step - loss: 32.2127 - val_loss: 33.7015
Epoch 17/30

1/1 [==============================] - 0s 13us/step - loss: 32.0706

1/1 [==============================] - 0s 135ms/step - loss: 32.0706 - val_loss: 33.5797
Epoch 18/30

1/1 [==============================] - 0s 14us/step - loss: 31.9289

1/1 [==============================] - 0s 154ms/step - loss: 31.9289 - val_loss: 33.4582
Epoch 19/30

1/1 [==============================] - 0s 14us/step - loss: 31.7876

1/1 [==============================] - 0s 139ms/step - loss: 31.7876 - val_loss: 33.3369
Epoch 20/30

1/1 [==============================] - 0s 15us/step - loss: 31.6468

1/1 [==============================] - 0s 137ms/step - loss: 31.6468 - val_loss: 33.2160
Epoch 21/30

1/1 [==============================] - 0s 17us/step - loss: 31.5064

1/1 [==============================] - 0s 144ms/step - loss: 31.5064 - val_loss: 33.0953
Epoch 22/30

1/1 [==============================] - 0s 13us/step - loss: 31.3665

1/1 [==============================] - 0s 135ms/step - loss: 31.3665 - val_loss: 32.9749
Epoch 23/30

1/1 [==============================] - 0s 14us/step - loss: 31.2269

1/1 [==============================] - 0s 135ms/step - loss: 31.2269 - val_loss: 32.8547
Epoch 24/30

1/1 [==============================] - 0s 14us/step - loss: 31.0877

1/1 [==============================] - 0s 135ms/step - loss: 31.0877 - val_loss: 32.7348
Epoch 25/30

1/1 [==============================] - 0s 14us/step - loss: 30.9489

1/1 [==============================] - 0s 136ms/step - loss: 30.9489 - val_loss: 32.6151
Epoch 26/30

1/1 [==============================] - 0s 13us/step - loss: 30.8106

1/1 [==============================] - 0s 134ms/step - loss: 30.8106 - val_loss: 32.4957
Epoch 27/30

1/1 [==============================] - 0s 13us/step - loss: 30.6726

1/1 [==============================] - 0s 136ms/step - loss: 30.6726 - val_loss: 32.3765
Epoch 28/30

1/1 [==============================] - 0s 13us/step - loss: 30.5349

1/1 [==============================] - 0s 135ms/step - loss: 30.5349 - val_loss: 32.2575
Epoch 29/30

1/1 [==============================] - 0s 12us/step - loss: 30.3977

1/1 [==============================] - 0s 132ms/step - loss: 30.3977 - val_loss: 32.1387
Epoch 30/30

1/1 [==============================] - 0s 10us/step - loss: 30.2607

1/1 [==============================] - 0s 136ms/step - loss: 30.2607 - val_loss: 32.0202

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-02T19-38-41Z

Training run 2/8 (flags = list(128, 1e-04, 200, 30, "sigmoid")) 
Using run directory runs/2020-11-02T19-38-46Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = dim(hitters_scale_train)[2]) %>%
+         layer_ .... [TRUNCATED] 

> set.seed(1)

> model %>% compile (
+         loss = 'mse',
+         optimizer = optimizer_sgd(lr=FLAGS$learning_rate))

> model %>% fit (x = as.matrix(hitters_scale_train), y = hitters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = .... [TRUNCATED] 
Epoch 1/30

1/2 [==============>...............] - ETA: 0s - loss: 32.5841
2/2 [==============================] - 0s 705us/step - loss: 32.4016

2/2 [==============================] - 1s 291ms/step - loss: 32.4016 - val_loss: 32.4801
Epoch 2/30

1/2 [==============>...............] - ETA: 0s - loss: 31.6476
2/2 [==============================] - 0s 887us/step - loss: 31.4588

2/2 [==============================] - 0s 71ms/step - loss: 31.4588 - val_loss: 31.5503
Epoch 3/30

1/2 [==============>...............] - ETA: 0s - loss: 30.3406
2/2 [==============================] - 0s 791us/step - loss: 30.5435

2/2 [==============================] - 0s 68ms/step - loss: 30.5435 - val_loss: 30.6138
Epoch 4/30

1/2 [==============>...............] - ETA: 0s - loss: 29.8690
2/2 [==============================] - 0s 975us/step - loss: 29.6275

2/2 [==============================] - 0s 71ms/step - loss: 29.6275 - val_loss: 29.7450
Epoch 5/30

1/2 [==============>...............] - ETA: 0s - loss: 28.6188
2/2 [==============================] - 0s 1ms/step - loss: 28.7723

2/2 [==============================] - 0s 72ms/step - loss: 28.7723 - val_loss: 28.8649
Epoch 6/30

1/2 [==============>...............] - ETA: 0s - loss: 28.0664
2/2 [==============================] - 0s 793us/step - loss: 27.9112

2/2 [==============================] - 0s 67ms/step - loss: 27.9112 - val_loss: 28.0408
Epoch 7/30

1/2 [==============>...............] - ETA: 0s - loss: 27.2473
2/2 [==============================] - 0s 1ms/step - loss: 27.1029

2/2 [==============================] - 0s 69ms/step - loss: 27.1029 - val_loss: 27.2385
Epoch 8/30

1/2 [==============>...............] - ETA: 0s - loss: 26.1831
2/2 [==============================] - 0s 922us/step - loss: 26.3147

2/2 [==============================] - 0s 67ms/step - loss: 26.3147 - val_loss: 26.4370
Epoch 9/30

1/2 [==============>...............] - ETA: 0s - loss: 25.2660
2/2 [==============================] - 0s 579us/step - loss: 25.5282

2/2 [==============================] - 0s 68ms/step - loss: 25.5282 - val_loss: 25.6456
Epoch 10/30

1/2 [==============>...............] - ETA: 0s - loss: 24.8402
2/2 [==============================] - 0s 1ms/step - loss: 24.7552

2/2 [==============================] - 0s 69ms/step - loss: 24.7552 - val_loss: 24.9117
Epoch 11/30

1/2 [==============>...............] - ETA: 0s - loss: 24.0374
2/2 [==============================] - 0s 1ms/step - loss: 24.0356

2/2 [==============================] - 0s 68ms/step - loss: 24.0356 - val_loss: 24.1890
Epoch 12/30

1/2 [==============>...............] - ETA: 0s - loss: 23.2597
2/2 [==============================] - 0s 1ms/step - loss: 23.3277

2/2 [==============================] - 0s 72ms/step - loss: 23.3277 - val_loss: 23.4832
Epoch 13/30

1/2 [==============>...............] - ETA: 0s - loss: 22.6126
2/2 [==============================] - 0s 871us/step - loss: 22.6371

2/2 [==============================] - 0s 67ms/step - loss: 22.6371 - val_loss: 22.8036
Epoch 14/30

1/2 [==============>...............] - ETA: 0s - loss: 21.8252
2/2 [==============================] - 0s 996us/step - loss: 21.9713

2/2 [==============================] - 0s 68ms/step - loss: 21.9713 - val_loss: 22.1335
Epoch 15/30

1/2 [==============>...............] - ETA: 0s - loss: 21.2576
2/2 [==============================] - 0s 998us/step - loss: 21.3161

2/2 [==============================] - 0s 67ms/step - loss: 21.3161 - val_loss: 21.4893
Epoch 16/30

1/2 [==============>...............] - ETA: 0s - loss: 20.7010
2/2 [==============================] - 0s 826us/step - loss: 20.6866

2/2 [==============================] - 0s 67ms/step - loss: 20.6866 - val_loss: 20.8711
Epoch 17/30

1/2 [==============>...............] - ETA: 0s - loss: 20.0604
2/2 [==============================] - 0s 979us/step - loss: 20.0819

2/2 [==============================] - 0s 70ms/step - loss: 20.0819 - val_loss: 20.2667
Epoch 18/30

1/2 [==============>...............] - ETA: 0s - loss: 19.5995
2/2 [==============================] - 0s 978us/step - loss: 19.4921

2/2 [==============================] - 0s 69ms/step - loss: 19.4921 - val_loss: 19.6936
Epoch 19/30

1/2 [==============>...............] - ETA: 0s - loss: 18.9969
2/2 [==============================] - 0s 1ms/step - loss: 18.9318

2/2 [==============================] - 0s 69ms/step - loss: 18.9318 - val_loss: 19.1331
Epoch 20/30

1/2 [==============>...............] - ETA: 0s - loss: 18.5862
2/2 [==============================] - 0s 899us/step - loss: 18.3851

2/2 [==============================] - 0s 67ms/step - loss: 18.3851 - val_loss: 18.5995
Epoch 21/30

1/2 [==============>...............] - ETA: 0s - loss: 18.1027
2/2 [==============================] - 0s 677us/step - loss: 17.8645

2/2 [==============================] - 0s 67ms/step - loss: 17.8645 - val_loss: 18.0868
Epoch 22/30

1/2 [==============>...............] - ETA: 0s - loss: 17.3068
2/2 [==============================] - 0s 861us/step - loss: 17.3622

2/2 [==============================] - 0s 72ms/step - loss: 17.3622 - val_loss: 17.5644
Epoch 23/30

1/2 [==============>...............] - ETA: 0s - loss: 16.7673
2/2 [==============================] - 0s 1ms/step - loss: 16.8523

2/2 [==============================] - 0s 68ms/step - loss: 16.8523 - val_loss: 17.0542
Epoch 24/30

1/2 [==============>...............] - ETA: 0s - loss: 16.5195
2/2 [==============================] - 0s 821us/step - loss: 16.3561

2/2 [==============================] - 0s 69ms/step - loss: 16.3561 - val_loss: 16.5801
Epoch 25/30

1/2 [==============>...............] - ETA: 0s - loss: 15.8990
2/2 [==============================] - 0s 1ms/step - loss: 15.8929

2/2 [==============================] - 0s 70ms/step - loss: 15.8929 - val_loss: 16.1069
Epoch 26/30

1/2 [==============>...............] - ETA: 0s - loss: 15.3819
2/2 [==============================] - 0s 1ms/step - loss: 15.4312

2/2 [==============================] - 0s 68ms/step - loss: 15.4312 - val_loss: 15.6422
Epoch 27/30

1/2 [==============>...............] - ETA: 0s - loss: 14.9736
2/2 [==============================] - 0s 801us/step - loss: 14.9786

2/2 [==============================] - 0s 66ms/step - loss: 14.9786 - val_loss: 15.1942
Epoch 28/30

1/2 [==============>...............] - ETA: 0s - loss: 14.3648
2/2 [==============================] - 0s 847us/step - loss: 14.5411

2/2 [==============================] - 0s 68ms/step - loss: 14.5411 - val_loss: 14.7441
Epoch 29/30

1/2 [==============>...............] - ETA: 0s - loss: 14.0025
2/2 [==============================] - 0s 995us/step - loss: 14.1036

2/2 [==============================] - 0s 68ms/step - loss: 14.1036 - val_loss: 14.3168
Epoch 30/30

1/2 [==============>...............] - ETA: 0s - loss: 13.8851
2/2 [==============================] - 0s 921us/step - loss: 13.6896

2/2 [==============================] - 0s 68ms/step - loss: 13.6896 - val_loss: 13.9268

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-02T19-38-46Z

Training run 3/8 (flags = list(392, 0.001, 500, 100, "relu")) 
Using run directory runs/2020-11-02T19-38-51Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = dim(hitters_scale_train)[2]) %>%
+         layer_ .... [TRUNCATED] 

> set.seed(1)

> model %>% compile (
+         loss = 'mse',
+         optimizer = optimizer_sgd(lr=FLAGS$learning_rate))

> model %>% fit (x = as.matrix(hitters_scale_train), y = hitters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = .... [TRUNCATED] 
Epoch 1/100

1/1 [==============================] - 0s 12us/step - loss: 34.9205

1/1 [==============================] - 1s 579ms/step - loss: 34.9205 - val_loss: 35.2827
Epoch 2/100

1/1 [==============================] - 0s 14us/step - loss: 33.9148

1/1 [==============================] - 0s 135ms/step - loss: 33.9148 - val_loss: 34.2635
Epoch 3/100

1/1 [==============================] - 0s 13us/step - loss: 32.9303

1/1 [==============================] - 0s 139ms/step - loss: 32.9303 - val_loss: 33.2639
Epoch 4/100

1/1 [==============================] - 0s 13us/step - loss: 31.9623

1/1 [==============================] - 0s 136ms/step - loss: 31.9623 - val_loss: 32.2780
Epoch 5/100

1/1 [==============================] - 0s 14us/step - loss: 31.0049

1/1 [==============================] - 0s 137ms/step - loss: 31.0049 - val_loss: 31.2994
Epoch 6/100

1/1 [==============================] - 0s 12us/step - loss: 30.0542

1/1 [==============================] - 0s 138ms/step - loss: 30.0542 - val_loss: 30.3225
Epoch 7/100

1/1 [==============================] - 0s 16us/step - loss: 29.1058

1/1 [==============================] - 0s 137ms/step - loss: 29.1058 - val_loss: 29.3424
Epoch 8/100

1/1 [==============================] - 0s 14us/step - loss: 28.1557

1/1 [==============================] - 0s 136ms/step - loss: 28.1557 - val_loss: 28.3553
Epoch 9/100

1/1 [==============================] - 0s 11us/step - loss: 27.2002

1/1 [==============================] - 0s 134ms/step - loss: 27.2002 - val_loss: 27.3617
Epoch 10/100

1/1 [==============================] - 0s 13us/step - loss: 26.2376

1/1 [==============================] - 0s 134ms/step - loss: 26.2376 - val_loss: 26.3574
Epoch 11/100

1/1 [==============================] - 0s 14us/step - loss: 25.2647

1/1 [==============================] - 0s 133ms/step - loss: 25.2647 - val_loss: 25.3433
Epoch 12/100

1/1 [==============================] - 0s 14us/step - loss: 24.2815

1/1 [==============================] - 0s 134ms/step - loss: 24.2815 - val_loss: 24.3179
Epoch 13/100

1/1 [==============================] - 0s 13us/step - loss: 23.2888

1/1 [==============================] - 0s 141ms/step - loss: 23.2888 - val_loss: 23.2802
Epoch 14/100

1/1 [==============================] - 0s 11us/step - loss: 22.2857

1/1 [==============================] - 0s 136ms/step - loss: 22.2857 - val_loss: 22.2326
Epoch 15/100

1/1 [==============================] - 0s 14us/step - loss: 21.2740

1/1 [==============================] - 0s 135ms/step - loss: 21.2740 - val_loss: 21.1778
Epoch 16/100

1/1 [==============================] - 0s 14us/step - loss: 20.2561

1/1 [==============================] - 0s 136ms/step - loss: 20.2561 - val_loss: 20.1174
Epoch 17/100

1/1 [==============================] - 0s 14us/step - loss: 19.2331

1/1 [==============================] - 0s 138ms/step - loss: 19.2331 - val_loss: 19.0552
Epoch 18/100

1/1 [==============================] - 0s 13us/step - loss: 18.2089

1/1 [==============================] - 0s 135ms/step - loss: 18.2089 - val_loss: 17.9932
Epoch 19/100

1/1 [==============================] - 0s 13us/step - loss: 17.1855

1/1 [==============================] - 0s 135ms/step - loss: 17.1855 - val_loss: 16.9373
Epoch 20/100

1/1 [==============================] - 0s 13us/step - loss: 16.1686

1/1 [==============================] - 0s 132ms/step - loss: 16.1686 - val_loss: 15.8911
Epoch 21/100

1/1 [==============================] - 0s 13us/step - loss: 15.1626

1/1 [==============================] - 0s 132ms/step - loss: 15.1626 - val_loss: 14.8600
Epoch 22/100

1/1 [==============================] - 0s 12us/step - loss: 14.1723

1/1 [==============================] - 0s 138ms/step - loss: 14.1723 - val_loss: 13.8492
Epoch 23/100

1/1 [==============================] - 0s 13us/step - loss: 13.2032

1/1 [==============================] - 0s 136ms/step - loss: 13.2032 - val_loss: 12.8633
Epoch 24/100

1/1 [==============================] - 0s 14us/step - loss: 12.2606

1/1 [==============================] - 0s 137ms/step - loss: 12.2606 - val_loss: 11.9091
Epoch 25/100

1/1 [==============================] - 0s 14us/step - loss: 11.3506

1/1 [==============================] - 0s 134ms/step - loss: 11.3506 - val_loss: 10.9944
Epoch 26/100

1/1 [==============================] - 0s 14us/step - loss: 10.4796

1/1 [==============================] - 0s 138ms/step - loss: 10.4796 - val_loss: 10.1240
Epoch 27/100

1/1 [==============================] - 0s 15us/step - loss: 9.6530

1/1 [==============================] - 0s 133ms/step - loss: 9.6530 - val_loss: 9.3025
Epoch 28/100

1/1 [==============================] - 0s 10us/step - loss: 8.8754

1/1 [==============================] - 0s 135ms/step - loss: 8.8754 - val_loss: 8.5349
Epoch 29/100

1/1 [==============================] - 0s 11us/step - loss: 8.1509

1/1 [==============================] - 0s 145ms/step - loss: 8.1509 - val_loss: 7.8244
Epoch 30/100

1/1 [==============================] - 0s 10us/step - loss: 7.4820

1/1 [==============================] - 0s 137ms/step - loss: 7.4820 - val_loss: 7.1736
Epoch 31/100

1/1 [==============================] - 0s 14us/step - loss: 6.8710

1/1 [==============================] - 0s 136ms/step - loss: 6.8710 - val_loss: 6.5830
Epoch 32/100

1/1 [==============================] - 0s 13us/step - loss: 6.3181

1/1 [==============================] - 0s 142ms/step - loss: 6.3181 - val_loss: 6.0520
Epoch 33/100

1/1 [==============================] - 0s 15us/step - loss: 5.8231

1/1 [==============================] - 0s 134ms/step - loss: 5.8231 - val_loss: 5.5788
Epoch 34/100

1/1 [==============================] - 0s 14us/step - loss: 5.3841

1/1 [==============================] - 0s 134ms/step - loss: 5.3841 - val_loss: 5.1609
Epoch 35/100

1/1 [==============================] - 0s 11us/step - loss: 4.9985

1/1 [==============================] - 0s 137ms/step - loss: 4.9985 - val_loss: 4.7953
Epoch 36/100

1/1 [==============================] - 0s 11us/step - loss: 4.6629

1/1 [==============================] - 0s 131ms/step - loss: 4.6629 - val_loss: 4.4777
Epoch 37/100

1/1 [==============================] - 0s 11us/step - loss: 4.3730

1/1 [==============================] - 0s 134ms/step - loss: 4.3730 - val_loss: 4.2039
Epoch 38/100

1/1 [==============================] - 0s 13us/step - loss: 4.1245

1/1 [==============================] - 0s 140ms/step - loss: 4.1245 - val_loss: 3.9693
Epoch 39/100

1/1 [==============================] - 0s 12us/step - loss: 3.9129

1/1 [==============================] - 0s 134ms/step - loss: 3.9129 - val_loss: 3.7695
Epoch 40/100

1/1 [==============================] - 0s 14us/step - loss: 3.7337

1/1 [==============================] - 0s 136ms/step - loss: 3.7337 - val_loss: 3.6001
Epoch 41/100

1/1 [==============================] - 0s 13us/step - loss: 3.5824

1/1 [==============================] - 0s 133ms/step - loss: 3.5824 - val_loss: 3.4569
Epoch 42/100

1/1 [==============================] - 0s 12us/step - loss: 3.4552

1/1 [==============================] - 0s 141ms/step - loss: 3.4552 - val_loss: 3.3360
Epoch 43/100

1/1 [==============================] - 0s 13us/step - loss: 3.3482

1/1 [==============================] - 0s 137ms/step - loss: 3.3482 - val_loss: 3.2340
Epoch 44/100

1/1 [==============================] - 0s 13us/step - loss: 3.2581

1/1 [==============================] - 0s 135ms/step - loss: 3.2581 - val_loss: 3.1481
Epoch 45/100

1/1 [==============================] - 0s 12us/step - loss: 3.1821

1/1 [==============================] - 0s 132ms/step - loss: 3.1821 - val_loss: 3.0755
Epoch 46/100

1/1 [==============================] - 0s 13us/step - loss: 3.1178

1/1 [==============================] - 0s 135ms/step - loss: 3.1178 - val_loss: 3.0140
Epoch 47/100

1/1 [==============================] - 0s 14us/step - loss: 3.0628

1/1 [==============================] - 0s 134ms/step - loss: 3.0628 - val_loss: 2.9614
Epoch 48/100

1/1 [==============================] - 0s 14us/step - loss: 3.0155

1/1 [==============================] - 0s 132ms/step - loss: 3.0155 - val_loss: 2.9164
Epoch 49/100

1/1 [==============================] - 0s 11us/step - loss: 2.9745

1/1 [==============================] - 0s 135ms/step - loss: 2.9745 - val_loss: 2.8777
Epoch 50/100

1/1 [==============================] - 0s 14us/step - loss: 2.9386

1/1 [==============================] - 0s 136ms/step - loss: 2.9386 - val_loss: 2.8440
Epoch 51/100

1/1 [==============================] - 0s 15us/step - loss: 2.9067

1/1 [==============================] - 0s 144ms/step - loss: 2.9067 - val_loss: 2.8144
Epoch 52/100

1/1 [==============================] - 0s 13us/step - loss: 2.8780

1/1 [==============================] - 0s 138ms/step - loss: 2.8780 - val_loss: 2.7882
Epoch 53/100

1/1 [==============================] - 0s 14us/step - loss: 2.8520

1/1 [==============================] - 0s 137ms/step - loss: 2.8520 - val_loss: 2.7647
Epoch 54/100

1/1 [==============================] - 0s 14us/step - loss: 2.8281

1/1 [==============================] - 0s 135ms/step - loss: 2.8281 - val_loss: 2.7436
Epoch 55/100

1/1 [==============================] - 0s 14us/step - loss: 2.8060

1/1 [==============================] - 0s 133ms/step - loss: 2.8060 - val_loss: 2.7244
Epoch 56/100

1/1 [==============================] - 0s 10us/step - loss: 2.7852

1/1 [==============================] - 0s 136ms/step - loss: 2.7852 - val_loss: 2.7068
Epoch 57/100

1/1 [==============================] - 0s 11us/step - loss: 2.7656

1/1 [==============================] - 0s 134ms/step - loss: 2.7656 - val_loss: 2.6905
Epoch 58/100

1/1 [==============================] - 0s 14us/step - loss: 2.7470

1/1 [==============================] - 0s 134ms/step - loss: 2.7470 - val_loss: 2.6752
Epoch 59/100

1/1 [==============================] - 0s 24us/step - loss: 2.7291

1/1 [==============================] - 0s 135ms/step - loss: 2.7291 - val_loss: 2.6609
Epoch 60/100

1/1 [==============================] - 0s 12us/step - loss: 2.7119

1/1 [==============================] - 0s 135ms/step - loss: 2.7119 - val_loss: 2.6473
Epoch 61/100

1/1 [==============================] - 0s 14us/step - loss: 2.6953

1/1 [==============================] - 0s 141ms/step - loss: 2.6953 - val_loss: 2.6344
Epoch 62/100

1/1 [==============================] - 0s 14us/step - loss: 2.6792

1/1 [==============================] - 0s 133ms/step - loss: 2.6792 - val_loss: 2.6220
Epoch 63/100

1/1 [==============================] - 0s 10us/step - loss: 2.6636

1/1 [==============================] - 0s 134ms/step - loss: 2.6636 - val_loss: 2.6101
Epoch 64/100

1/1 [==============================] - 0s 11us/step - loss: 2.6483

1/1 [==============================] - 0s 133ms/step - loss: 2.6483 - val_loss: 2.5987
Epoch 65/100

1/1 [==============================] - 0s 11us/step - loss: 2.6334

1/1 [==============================] - 0s 133ms/step - loss: 2.6334 - val_loss: 2.5875
Epoch 66/100

1/1 [==============================] - 0s 11us/step - loss: 2.6188

1/1 [==============================] - 0s 136ms/step - loss: 2.6188 - val_loss: 2.5767
Epoch 67/100

1/1 [==============================] - 0s 14us/step - loss: 2.6045

1/1 [==============================] - 0s 134ms/step - loss: 2.6045 - val_loss: 2.5661
Epoch 68/100

1/1 [==============================] - 0s 13us/step - loss: 2.5904

1/1 [==============================] - 0s 137ms/step - loss: 2.5904 - val_loss: 2.5558
Epoch 69/100

1/1 [==============================] - 0s 12us/step - loss: 2.5766

1/1 [==============================] - 0s 134ms/step - loss: 2.5766 - val_loss: 2.5457
Epoch 70/100

1/1 [==============================] - 0s 13us/step - loss: 2.5629

1/1 [==============================] - 0s 133ms/step - loss: 2.5629 - val_loss: 2.5359
Epoch 71/100

1/1 [==============================] - 0s 11us/step - loss: 2.5495

1/1 [==============================] - 0s 139ms/step - loss: 2.5495 - val_loss: 2.5261
Epoch 72/100

1/1 [==============================] - 0s 14us/step - loss: 2.5363

1/1 [==============================] - 0s 135ms/step - loss: 2.5363 - val_loss: 2.5166
Epoch 73/100

1/1 [==============================] - 0s 11us/step - loss: 2.5233

1/1 [==============================] - 0s 134ms/step - loss: 2.5233 - val_loss: 2.5072
Epoch 74/100

1/1 [==============================] - 0s 15us/step - loss: 2.5105

1/1 [==============================] - 0s 133ms/step - loss: 2.5105 - val_loss: 2.4978
Epoch 75/100

1/1 [==============================] - 0s 13us/step - loss: 2.4979

1/1 [==============================] - 0s 134ms/step - loss: 2.4979 - val_loss: 2.4886
Epoch 76/100

1/1 [==============================] - 0s 13us/step - loss: 2.4854

1/1 [==============================] - 0s 134ms/step - loss: 2.4854 - val_loss: 2.4795
Epoch 77/100

1/1 [==============================] - 0s 15us/step - loss: 2.4731

1/1 [==============================] - 0s 134ms/step - loss: 2.4731 - val_loss: 2.4705
Epoch 78/100

1/1 [==============================] - 0s 12us/step - loss: 2.4610

1/1 [==============================] - 0s 133ms/step - loss: 2.4610 - val_loss: 2.4615
Epoch 79/100

1/1 [==============================] - 0s 14us/step - loss: 2.4490

1/1 [==============================] - 0s 133ms/step - loss: 2.4490 - val_loss: 2.4527
Epoch 80/100

1/1 [==============================] - 0s 11us/step - loss: 2.4371

1/1 [==============================] - 0s 141ms/step - loss: 2.4371 - val_loss: 2.4440
Epoch 81/100

1/1 [==============================] - 0s 14us/step - loss: 2.4253

1/1 [==============================] - 0s 133ms/step - loss: 2.4253 - val_loss: 2.4353
Epoch 82/100

1/1 [==============================] - 0s 13us/step - loss: 2.4137

1/1 [==============================] - 0s 132ms/step - loss: 2.4137 - val_loss: 2.4266
Epoch 83/100

1/1 [==============================] - 0s 15us/step - loss: 2.4022

1/1 [==============================] - 0s 137ms/step - loss: 2.4022 - val_loss: 2.4181
Epoch 84/100

1/1 [==============================] - 0s 14us/step - loss: 2.3909

1/1 [==============================] - 0s 135ms/step - loss: 2.3909 - val_loss: 2.4096
Epoch 85/100

1/1 [==============================] - 0s 14us/step - loss: 2.3796

1/1 [==============================] - 0s 133ms/step - loss: 2.3796 - val_loss: 2.4012
Epoch 86/100

1/1 [==============================] - 0s 13us/step - loss: 2.3685

1/1 [==============================] - 0s 134ms/step - loss: 2.3685 - val_loss: 2.3929
Epoch 87/100

1/1 [==============================] - 0s 14us/step - loss: 2.3576

1/1 [==============================] - 0s 133ms/step - loss: 2.3576 - val_loss: 2.3846
Epoch 88/100

1/1 [==============================] - 0s 14us/step - loss: 2.3467

1/1 [==============================] - 0s 135ms/step - loss: 2.3467 - val_loss: 2.3763
Epoch 89/100

1/1 [==============================] - 0s 13us/step - loss: 2.3360

1/1 [==============================] - 0s 132ms/step - loss: 2.3360 - val_loss: 2.3681
Epoch 90/100

1/1 [==============================] - 0s 14us/step - loss: 2.3254

1/1 [==============================] - 0s 143ms/step - loss: 2.3254 - val_loss: 2.3599
Epoch 91/100

1/1 [==============================] - 0s 14us/step - loss: 2.3149

1/1 [==============================] - 0s 135ms/step - loss: 2.3149 - val_loss: 2.3517
Epoch 92/100

1/1 [==============================] - 0s 12us/step - loss: 2.3044

1/1 [==============================] - 0s 135ms/step - loss: 2.3044 - val_loss: 2.3436
Epoch 93/100

1/1 [==============================] - 0s 13us/step - loss: 2.2941

1/1 [==============================] - 0s 132ms/step - loss: 2.2941 - val_loss: 2.3355
Epoch 94/100

1/1 [==============================] - 0s 10us/step - loss: 2.2838

1/1 [==============================] - 0s 136ms/step - loss: 2.2838 - val_loss: 2.3274
Epoch 95/100

1/1 [==============================] - 0s 14us/step - loss: 2.2737

1/1 [==============================] - 0s 136ms/step - loss: 2.2737 - val_loss: 2.3193
Epoch 96/100

1/1 [==============================] - 0s 14us/step - loss: 2.2636

1/1 [==============================] - 0s 135ms/step - loss: 2.2636 - val_loss: 2.3113
Epoch 97/100

1/1 [==============================] - 0s 14us/step - loss: 2.2536

1/1 [==============================] - 0s 135ms/step - loss: 2.2536 - val_loss: 2.3034
Epoch 98/100

1/1 [==============================] - 0s 14us/step - loss: 2.2437

1/1 [==============================] - 0s 134ms/step - loss: 2.2437 - val_loss: 2.2954
Epoch 99/100

1/1 [==============================] - 0s 14us/step - loss: 2.2338

1/1 [==============================] - 0s 134ms/step - loss: 2.2338 - val_loss: 2.2876
Epoch 100/100

1/1 [==============================] - 0s 13us/step - loss: 2.2241

1/1 [==============================] - 0s 143ms/step - loss: 2.2241 - val_loss: 2.2797

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-02T19-38-51Z

Training run 4/8 (flags = list(64, 1e-04, 500, 100, "tanh")) 
Using run directory runs/2020-11-02T19-39-06Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = dim(hitters_scale_train)[2]) %>%
+         layer_ .... [TRUNCATED] 

> set.seed(1)

> model %>% compile (
+         loss = 'mse',
+         optimizer = optimizer_sgd(lr=FLAGS$learning_rate))

> model %>% fit (x = as.matrix(hitters_scale_train), y = hitters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = .... [TRUNCATED] 
Epoch 1/100

1/1 [==============================] - 0s 11us/step - loss: 35.9695

1/1 [==============================] - 1s 581ms/step - loss: 35.9695 - val_loss: 35.6071
Epoch 2/100

1/1 [==============================] - 0s 16us/step - loss: 35.8771

1/1 [==============================] - 0s 137ms/step - loss: 35.8771 - val_loss: 35.5215
Epoch 3/100

1/1 [==============================] - 0s 10us/step - loss: 35.7850

1/1 [==============================] - 0s 134ms/step - loss: 35.7850 - val_loss: 35.4362
Epoch 4/100

1/1 [==============================] - 0s 15us/step - loss: 35.6931

1/1 [==============================] - 0s 137ms/step - loss: 35.6931 - val_loss: 35.3511
Epoch 5/100

1/1 [==============================] - 0s 13us/step - loss: 35.6016

1/1 [==============================] - 0s 137ms/step - loss: 35.6016 - val_loss: 35.2662
Epoch 6/100

1/1 [==============================] - 0s 42us/step - loss: 35.5102

1/1 [==============================] - 0s 138ms/step - loss: 35.5102 - val_loss: 35.1815
Epoch 7/100

1/1 [==============================] - 0s 10us/step - loss: 35.4191

1/1 [==============================] - 0s 134ms/step - loss: 35.4191 - val_loss: 35.0970
Epoch 8/100

1/1 [==============================] - 0s 17us/step - loss: 35.3283

1/1 [==============================] - 0s 138ms/step - loss: 35.3283 - val_loss: 35.0127
Epoch 9/100

1/1 [==============================] - 0s 13us/step - loss: 35.2377

1/1 [==============================] - 0s 133ms/step - loss: 35.2377 - val_loss: 34.9286
Epoch 10/100

1/1 [==============================] - 0s 11us/step - loss: 35.1474

1/1 [==============================] - 0s 132ms/step - loss: 35.1474 - val_loss: 34.8447
Epoch 11/100

1/1 [==============================] - 0s 13us/step - loss: 35.0573

1/1 [==============================] - 0s 140ms/step - loss: 35.0573 - val_loss: 34.7610
Epoch 12/100

1/1 [==============================] - 0s 25us/step - loss: 34.9674

1/1 [==============================] - 0s 131ms/step - loss: 34.9674 - val_loss: 34.6775
Epoch 13/100

1/1 [==============================] - 0s 22us/step - loss: 34.8778

1/1 [==============================] - 0s 133ms/step - loss: 34.8778 - val_loss: 34.5942
Epoch 14/100

1/1 [==============================] - 0s 10us/step - loss: 34.7883

1/1 [==============================] - 0s 136ms/step - loss: 34.7883 - val_loss: 34.5111
Epoch 15/100

1/1 [==============================] - 0s 16us/step - loss: 34.6991

1/1 [==============================] - 0s 145ms/step - loss: 34.6991 - val_loss: 34.4281
Epoch 16/100

1/1 [==============================] - 0s 10us/step - loss: 34.6102

1/1 [==============================] - 0s 138ms/step - loss: 34.6102 - val_loss: 34.3453
Epoch 17/100

1/1 [==============================] - 0s 16us/step - loss: 34.5214

1/1 [==============================] - 0s 136ms/step - loss: 34.5214 - val_loss: 34.2627
Epoch 18/100

1/1 [==============================] - 0s 15us/step - loss: 34.4329

1/1 [==============================] - 0s 135ms/step - loss: 34.4329 - val_loss: 34.1803
Epoch 19/100

1/1 [==============================] - 0s 12us/step - loss: 34.3446

1/1 [==============================] - 0s 133ms/step - loss: 34.3446 - val_loss: 34.0981
Epoch 20/100

1/1 [==============================] - 0s 16us/step - loss: 34.2564

1/1 [==============================] - 0s 133ms/step - loss: 34.2564 - val_loss: 34.0160
Epoch 21/100

1/1 [==============================] - 0s 10us/step - loss: 34.1685

1/1 [==============================] - 0s 143ms/step - loss: 34.1685 - val_loss: 33.9341
Epoch 22/100

1/1 [==============================] - 0s 19us/step - loss: 34.0808

1/1 [==============================] - 0s 136ms/step - loss: 34.0808 - val_loss: 33.8524
Epoch 23/100

1/1 [==============================] - 0s 12us/step - loss: 33.9933

1/1 [==============================] - 0s 135ms/step - loss: 33.9933 - val_loss: 33.7708
Epoch 24/100

1/1 [==============================] - 0s 15us/step - loss: 33.9060

1/1 [==============================] - 0s 137ms/step - loss: 33.9060 - val_loss: 33.6893
Epoch 25/100

1/1 [==============================] - 0s 15us/step - loss: 33.8189

1/1 [==============================] - 0s 135ms/step - loss: 33.8189 - val_loss: 33.6081
Epoch 26/100

1/1 [==============================] - 0s 15us/step - loss: 33.7320

1/1 [==============================] - 0s 134ms/step - loss: 33.7320 - val_loss: 33.5270
Epoch 27/100

1/1 [==============================] - 0s 13us/step - loss: 33.6453

1/1 [==============================] - 0s 136ms/step - loss: 33.6453 - val_loss: 33.4460
Epoch 28/100

1/1 [==============================] - 0s 16us/step - loss: 33.5587

1/1 [==============================] - 0s 134ms/step - loss: 33.5587 - val_loss: 33.3652
Epoch 29/100

1/1 [==============================] - 0s 11us/step - loss: 33.4723

1/1 [==============================] - 0s 136ms/step - loss: 33.4723 - val_loss: 33.2845
Epoch 30/100

1/1 [==============================] - 0s 12us/step - loss: 33.3862

1/1 [==============================] - 0s 140ms/step - loss: 33.3862 - val_loss: 33.2040
Epoch 31/100

1/1 [==============================] - 0s 15us/step - loss: 33.3002

1/1 [==============================] - 0s 136ms/step - loss: 33.3002 - val_loss: 33.1236
Epoch 32/100

1/1 [==============================] - 0s 16us/step - loss: 33.2143

1/1 [==============================] - 0s 136ms/step - loss: 33.2143 - val_loss: 33.0434
Epoch 33/100

1/1 [==============================] - 0s 16us/step - loss: 33.1287

1/1 [==============================] - 0s 134ms/step - loss: 33.1287 - val_loss: 32.9633
Epoch 34/100

1/1 [==============================] - 0s 12us/step - loss: 33.0432

1/1 [==============================] - 0s 136ms/step - loss: 33.0432 - val_loss: 32.8833
Epoch 35/100

1/1 [==============================] - 0s 21us/step - loss: 32.9579

1/1 [==============================] - 0s 137ms/step - loss: 32.9579 - val_loss: 32.8035
Epoch 36/100

1/1 [==============================] - 0s 13us/step - loss: 32.8727

1/1 [==============================] - 0s 135ms/step - loss: 32.8727 - val_loss: 32.7237
Epoch 37/100

1/1 [==============================] - 0s 15us/step - loss: 32.7878

1/1 [==============================] - 0s 136ms/step - loss: 32.7878 - val_loss: 32.6442
Epoch 38/100

1/1 [==============================] - 0s 15us/step - loss: 32.7029

1/1 [==============================] - 0s 134ms/step - loss: 32.7029 - val_loss: 32.5647
Epoch 39/100

1/1 [==============================] - 0s 18us/step - loss: 32.6183

1/1 [==============================] - 0s 135ms/step - loss: 32.6183 - val_loss: 32.4854
Epoch 40/100

1/1 [==============================] - 0s 12us/step - loss: 32.5338

1/1 [==============================] - 0s 140ms/step - loss: 32.5338 - val_loss: 32.4062
Epoch 41/100

1/1 [==============================] - 0s 15us/step - loss: 32.4494

1/1 [==============================] - 0s 137ms/step - loss: 32.4494 - val_loss: 32.3271
Epoch 42/100

1/1 [==============================] - 0s 16us/step - loss: 32.3652

1/1 [==============================] - 0s 134ms/step - loss: 32.3652 - val_loss: 32.2481
Epoch 43/100

1/1 [==============================] - 0s 10us/step - loss: 32.2812

1/1 [==============================] - 0s 136ms/step - loss: 32.2812 - val_loss: 32.1693
Epoch 44/100

1/1 [==============================] - 0s 15us/step - loss: 32.1973

1/1 [==============================] - 0s 133ms/step - loss: 32.1973 - val_loss: 32.0905
Epoch 45/100

1/1 [==============================] - 0s 11us/step - loss: 32.1135

1/1 [==============================] - 0s 133ms/step - loss: 32.1135 - val_loss: 32.0119
Epoch 46/100

1/1 [==============================] - 0s 15us/step - loss: 32.0299

1/1 [==============================] - 0s 134ms/step - loss: 32.0299 - val_loss: 31.9334
Epoch 47/100

1/1 [==============================] - 0s 26us/step - loss: 31.9464

1/1 [==============================] - 0s 139ms/step - loss: 31.9464 - val_loss: 31.8550
Epoch 48/100

1/1 [==============================] - 0s 23us/step - loss: 31.8631

1/1 [==============================] - 0s 137ms/step - loss: 31.8631 - val_loss: 31.7767
Epoch 49/100

1/1 [==============================] - 0s 21us/step - loss: 31.7799

1/1 [==============================] - 0s 132ms/step - loss: 31.7799 - val_loss: 31.6985
Epoch 50/100

1/1 [==============================] - 0s 11us/step - loss: 31.6969

1/1 [==============================] - 0s 146ms/step - loss: 31.6969 - val_loss: 31.6204
Epoch 51/100

1/1 [==============================] - 0s 11us/step - loss: 31.6139

1/1 [==============================] - 0s 133ms/step - loss: 31.6139 - val_loss: 31.5424
Epoch 52/100

1/1 [==============================] - 0s 13us/step - loss: 31.5311

1/1 [==============================] - 0s 134ms/step - loss: 31.5311 - val_loss: 31.4646
Epoch 53/100

1/1 [==============================] - 0s 14us/step - loss: 31.4485

1/1 [==============================] - 0s 135ms/step - loss: 31.4485 - val_loss: 31.3868
Epoch 54/100

1/1 [==============================] - 0s 15us/step - loss: 31.3659

1/1 [==============================] - 0s 136ms/step - loss: 31.3659 - val_loss: 31.3091
Epoch 55/100

1/1 [==============================] - 0s 12us/step - loss: 31.2835

1/1 [==============================] - 0s 134ms/step - loss: 31.2835 - val_loss: 31.2315
Epoch 56/100

1/1 [==============================] - 0s 26us/step - loss: 31.2012

1/1 [==============================] - 0s 134ms/step - loss: 31.2012 - val_loss: 31.1540
Epoch 57/100

1/1 [==============================] - 0s 9us/step - loss: 31.1191

1/1 [==============================] - 0s 133ms/step - loss: 31.1191 - val_loss: 31.0766
Epoch 58/100

1/1 [==============================] - 0s 15us/step - loss: 31.0370

1/1 [==============================] - 0s 133ms/step - loss: 31.0370 - val_loss: 30.9992
Epoch 59/100

1/1 [==============================] - 0s 13us/step - loss: 30.9551

1/1 [==============================] - 0s 138ms/step - loss: 30.9551 - val_loss: 30.9220
Epoch 60/100

1/1 [==============================] - 0s 10us/step - loss: 30.8733

1/1 [==============================] - 0s 134ms/step - loss: 30.8733 - val_loss: 30.8448
Epoch 61/100

1/1 [==============================] - 0s 20us/step - loss: 30.7916

1/1 [==============================] - 0s 137ms/step - loss: 30.7916 - val_loss: 30.7678
Epoch 62/100

1/1 [==============================] - 0s 14us/step - loss: 30.7100

1/1 [==============================] - 0s 134ms/step - loss: 30.7100 - val_loss: 30.6908
Epoch 63/100

1/1 [==============================] - 0s 13us/step - loss: 30.6285

1/1 [==============================] - 0s 133ms/step - loss: 30.6285 - val_loss: 30.6139
Epoch 64/100

1/1 [==============================] - 0s 16us/step - loss: 30.5472

1/1 [==============================] - 0s 133ms/step - loss: 30.5472 - val_loss: 30.5371
Epoch 65/100

1/1 [==============================] - 0s 10us/step - loss: 30.4659

1/1 [==============================] - 0s 134ms/step - loss: 30.4659 - val_loss: 30.4603
Epoch 66/100

1/1 [==============================] - 0s 14us/step - loss: 30.3848

1/1 [==============================] - 0s 136ms/step - loss: 30.3848 - val_loss: 30.3837
Epoch 67/100

1/1 [==============================] - 0s 14us/step - loss: 30.3037

1/1 [==============================] - 0s 134ms/step - loss: 30.3037 - val_loss: 30.3071
Epoch 68/100

1/1 [==============================] - 0s 33us/step - loss: 30.2228

1/1 [==============================] - 0s 133ms/step - loss: 30.2228 - val_loss: 30.2306
Epoch 69/100

1/1 [==============================] - 0s 10us/step - loss: 30.1419

1/1 [==============================] - 0s 140ms/step - loss: 30.1419 - val_loss: 30.1541
Epoch 70/100

1/1 [==============================] - 0s 15us/step - loss: 30.0612

1/1 [==============================] - 0s 136ms/step - loss: 30.0612 - val_loss: 30.0778
Epoch 71/100

1/1 [==============================] - 0s 16us/step - loss: 29.9806

1/1 [==============================] - 0s 133ms/step - loss: 29.9806 - val_loss: 30.0015
Epoch 72/100

1/1 [==============================] - 0s 13us/step - loss: 29.9000

1/1 [==============================] - 0s 134ms/step - loss: 29.9000 - val_loss: 29.9252
Epoch 73/100

1/1 [==============================] - 0s 16us/step - loss: 29.8196

1/1 [==============================] - 0s 138ms/step - loss: 29.8196 - val_loss: 29.8491
Epoch 74/100

1/1 [==============================] - 0s 16us/step - loss: 29.7392

1/1 [==============================] - 0s 142ms/step - loss: 29.7392 - val_loss: 29.7730
Epoch 75/100

1/1 [==============================] - 0s 15us/step - loss: 29.6589

1/1 [==============================] - 0s 135ms/step - loss: 29.6589 - val_loss: 29.6970
Epoch 76/100

1/1 [==============================] - 0s 17us/step - loss: 29.5788

1/1 [==============================] - 0s 136ms/step - loss: 29.5788 - val_loss: 29.6210
Epoch 77/100

1/1 [==============================] - 0s 15us/step - loss: 29.4987

1/1 [==============================] - 0s 133ms/step - loss: 29.4987 - val_loss: 29.5451
Epoch 78/100

1/1 [==============================] - 0s 15us/step - loss: 29.4187

1/1 [==============================] - 0s 132ms/step - loss: 29.4187 - val_loss: 29.4693
Epoch 79/100

1/1 [==============================] - 0s 10us/step - loss: 29.3388

1/1 [==============================] - 0s 144ms/step - loss: 29.3388 - val_loss: 29.3935
Epoch 80/100

1/1 [==============================] - 0s 17us/step - loss: 29.2590

1/1 [==============================] - 0s 137ms/step - loss: 29.2590 - val_loss: 29.3178
Epoch 81/100

1/1 [==============================] - 0s 15us/step - loss: 29.1792

1/1 [==============================] - 0s 137ms/step - loss: 29.1792 - val_loss: 29.2421
Epoch 82/100

1/1 [==============================] - 0s 16us/step - loss: 29.0996

1/1 [==============================] - 0s 137ms/step - loss: 29.0996 - val_loss: 29.1665
Epoch 83/100

1/1 [==============================] - 0s 16us/step - loss: 29.0200

1/1 [==============================] - 0s 137ms/step - loss: 29.0200 - val_loss: 29.0910
Epoch 84/100

1/1 [==============================] - 0s 16us/step - loss: 28.9405

1/1 [==============================] - 0s 135ms/step - loss: 28.9405 - val_loss: 29.0155
Epoch 85/100

1/1 [==============================] - 0s 16us/step - loss: 28.8611

1/1 [==============================] - 0s 133ms/step - loss: 28.8611 - val_loss: 28.9401
Epoch 86/100

1/1 [==============================] - 0s 10us/step - loss: 28.7818

1/1 [==============================] - 0s 136ms/step - loss: 28.7818 - val_loss: 28.8647
Epoch 87/100

1/1 [==============================] - 0s 17us/step - loss: 28.7026

1/1 [==============================] - 0s 137ms/step - loss: 28.7026 - val_loss: 28.7894
Epoch 88/100

1/1 [==============================] - 0s 45us/step - loss: 28.6234

1/1 [==============================] - 0s 143ms/step - loss: 28.6234 - val_loss: 28.7141
Epoch 89/100

1/1 [==============================] - 0s 16us/step - loss: 28.5443

1/1 [==============================] - 0s 137ms/step - loss: 28.5443 - val_loss: 28.6389
Epoch 90/100

1/1 [==============================] - 0s 16us/step - loss: 28.4653

1/1 [==============================] - 0s 135ms/step - loss: 28.4653 - val_loss: 28.5637
Epoch 91/100

1/1 [==============================] - 0s 16us/step - loss: 28.3863

1/1 [==============================] - 0s 135ms/step - loss: 28.3863 - val_loss: 28.4886
Epoch 92/100

1/1 [==============================] - 0s 17us/step - loss: 28.3074

1/1 [==============================] - 0s 133ms/step - loss: 28.3074 - val_loss: 28.4135
Epoch 93/100

1/1 [==============================] - 0s 10us/step - loss: 28.2286

1/1 [==============================] - 0s 132ms/step - loss: 28.2286 - val_loss: 28.3385
Epoch 94/100

1/1 [==============================] - 0s 11us/step - loss: 28.1499

1/1 [==============================] - 0s 134ms/step - loss: 28.1499 - val_loss: 28.2635
Epoch 95/100

1/1 [==============================] - 0s 15us/step - loss: 28.0712

1/1 [==============================] - 0s 137ms/step - loss: 28.0712 - val_loss: 28.1885
Epoch 96/100

1/1 [==============================] - 0s 14us/step - loss: 27.9926

1/1 [==============================] - 0s 135ms/step - loss: 27.9926 - val_loss: 28.1136
Epoch 97/100

1/1 [==============================] - 0s 16us/step - loss: 27.9141

1/1 [==============================] - 0s 135ms/step - loss: 27.9141 - val_loss: 28.0388
Epoch 98/100

1/1 [==============================] - 0s 14us/step - loss: 27.8356

1/1 [==============================] - 0s 137ms/step - loss: 27.8356 - val_loss: 27.9640
Epoch 99/100

1/1 [==============================] - 0s 15us/step - loss: 27.7572

1/1 [==============================] - 0s 135ms/step - loss: 27.7572 - val_loss: 27.8892
Epoch 100/100

1/1 [==============================] - 0s 15us/step - loss: 27.6789

1/1 [==============================] - 0s 135ms/step - loss: 27.6789 - val_loss: 27.8145

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-02T19-39-06Z

Training run 5/8 (flags = list(128, 1e-04, 100, 30, "tanh")) 
Using run directory runs/2020-11-02T19-39-21Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = dim(hitters_scale_train)[2]) %>%
+         layer_ .... [TRUNCATED] 

> set.seed(1)

> model %>% compile (
+         loss = 'mse',
+         optimizer = optimizer_sgd(lr=FLAGS$learning_rate))

> model %>% fit (x = as.matrix(hitters_scale_train), y = hitters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = .... [TRUNCATED] 
Epoch 1/30

1/3 [=========>....................] - ETA: 0s - loss: 36.4107
3/3 [==============================] - 0s 999us/step - loss: 36.3974

3/3 [==============================] - 1s 199ms/step - loss: 36.3974 - val_loss: 35.6196
Epoch 2/30

1/3 [=========>....................] - ETA: 0s - loss: 36.9115
3/3 [==============================] - 0s 1ms/step - loss: 36.1262

3/3 [==============================] - 0s 48ms/step - loss: 36.1262 - val_loss: 35.3767
Epoch 3/30

1/3 [=========>....................] - ETA: 0s - loss: 35.8315
3/3 [==============================] - 0s 1ms/step - loss: 35.8532

3/3 [==============================] - 0s 46ms/step - loss: 35.8532 - val_loss: 35.1307
Epoch 4/30

1/3 [=========>....................] - ETA: 0s - loss: 35.5317
3/3 [==============================] - 0s 1ms/step - loss: 35.5815

3/3 [==============================] - 0s 47ms/step - loss: 35.5815 - val_loss: 34.9101
Epoch 5/30

1/3 [=========>....................] - ETA: 0s - loss: 34.7389
3/3 [==============================] - 0s 1ms/step - loss: 35.3183

3/3 [==============================] - 0s 48ms/step - loss: 35.3183 - val_loss: 34.6800
Epoch 6/30

1/3 [=========>....................] - ETA: 0s - loss: 36.0036
3/3 [==============================] - 0s 1ms/step - loss: 35.0704

3/3 [==============================] - 0s 46ms/step - loss: 35.0704 - val_loss: 34.4620
Epoch 7/30

1/3 [=========>....................] - ETA: 0s - loss: 34.1088
3/3 [==============================] - 0s 1ms/step - loss: 34.8066

3/3 [==============================] - 0s 46ms/step - loss: 34.8066 - val_loss: 34.2507
Epoch 8/30

1/3 [=========>....................] - ETA: 0s - loss: 35.5251
3/3 [==============================] - 0s 1ms/step - loss: 34.5452

3/3 [==============================] - 0s 46ms/step - loss: 34.5452 - val_loss: 34.0522
Epoch 9/30

1/3 [=========>....................] - ETA: 0s - loss: 34.8235
3/3 [==============================] - 0s 1ms/step - loss: 34.2870

3/3 [==============================] - 0s 47ms/step - loss: 34.2870 - val_loss: 33.8415
Epoch 10/30

1/3 [=========>....................] - ETA: 0s - loss: 32.9989
3/3 [==============================] - 0s 1ms/step - loss: 34.0380

3/3 [==============================] - 0s 45ms/step - loss: 34.0380 - val_loss: 33.6215
Epoch 11/30

1/3 [=========>....................] - ETA: 0s - loss: 32.0274
3/3 [==============================] - 0s 911us/step - loss: 33.7748

3/3 [==============================] - 0s 45ms/step - loss: 33.7748 - val_loss: 33.4119
Epoch 12/30

1/3 [=========>....................] - ETA: 0s - loss: 34.3070
3/3 [==============================] - 0s 1ms/step - loss: 33.5200

3/3 [==============================] - 0s 45ms/step - loss: 33.5200 - val_loss: 33.1926
Epoch 13/30

1/3 [=========>....................] - ETA: 0s - loss: 33.1277
3/3 [==============================] - 0s 1ms/step - loss: 33.2639

3/3 [==============================] - 0s 45ms/step - loss: 33.2639 - val_loss: 32.9949
Epoch 14/30

1/3 [=========>....................] - ETA: 0s - loss: 33.3654
3/3 [==============================] - 0s 1ms/step - loss: 33.0066

3/3 [==============================] - 0s 46ms/step - loss: 33.0066 - val_loss: 32.7898
Epoch 15/30

1/3 [=========>....................] - ETA: 0s - loss: 32.7411
3/3 [==============================] - 0s 1ms/step - loss: 32.7479

3/3 [==============================] - 0s 45ms/step - loss: 32.7479 - val_loss: 32.5735
Epoch 16/30

1/3 [=========>....................] - ETA: 0s - loss: 31.1908
3/3 [==============================] - 0s 1ms/step - loss: 32.5124

3/3 [==============================] - 0s 46ms/step - loss: 32.5124 - val_loss: 32.3716
Epoch 17/30

1/3 [=========>....................] - ETA: 0s - loss: 32.1822
3/3 [==============================] - 0s 1ms/step - loss: 32.2562

3/3 [==============================] - 0s 46ms/step - loss: 32.2562 - val_loss: 32.1707
Epoch 18/30

1/3 [=========>....................] - ETA: 0s - loss: 30.7002
3/3 [==============================] - 0s 1ms/step - loss: 32.0130

3/3 [==============================] - 0s 45ms/step - loss: 32.0130 - val_loss: 31.9694
Epoch 19/30

1/3 [=========>....................] - ETA: 0s - loss: 32.2222
3/3 [==============================] - 0s 1ms/step - loss: 31.7801

3/3 [==============================] - 0s 48ms/step - loss: 31.7801 - val_loss: 31.7613
Epoch 20/30

1/3 [=========>....................] - ETA: 0s - loss: 32.1743
3/3 [==============================] - 0s 1ms/step - loss: 31.5454

3/3 [==============================] - 0s 46ms/step - loss: 31.5454 - val_loss: 31.5422
Epoch 21/30

1/3 [=========>....................] - ETA: 0s - loss: 31.7503
3/3 [==============================] - 0s 1ms/step - loss: 31.2986

3/3 [==============================] - 0s 46ms/step - loss: 31.2986 - val_loss: 31.3280
Epoch 22/30

1/3 [=========>....................] - ETA: 0s - loss: 30.4608
3/3 [==============================] - 0s 1ms/step - loss: 31.0572

3/3 [==============================] - 0s 47ms/step - loss: 31.0572 - val_loss: 31.1152
Epoch 23/30

1/3 [=========>....................] - ETA: 0s - loss: 30.2903
3/3 [==============================] - 0s 1ms/step - loss: 30.8076

3/3 [==============================] - 0s 46ms/step - loss: 30.8076 - val_loss: 30.9019
Epoch 24/30

1/3 [=========>....................] - ETA: 0s - loss: 31.0547
3/3 [==============================] - 0s 1ms/step - loss: 30.5730

3/3 [==============================] - 0s 47ms/step - loss: 30.5730 - val_loss: 30.6832
Epoch 25/30

1/3 [=========>....................] - ETA: 0s - loss: 30.4960
3/3 [==============================] - 0s 1ms/step - loss: 30.3355

3/3 [==============================] - 0s 45ms/step - loss: 30.3355 - val_loss: 30.4809
Epoch 26/30

1/3 [=========>....................] - ETA: 0s - loss: 30.0551
3/3 [==============================] - 0s 1ms/step - loss: 30.1010

3/3 [==============================] - 0s 46ms/step - loss: 30.1010 - val_loss: 30.2820
Epoch 27/30

1/3 [=========>....................] - ETA: 0s - loss: 29.5303
3/3 [==============================] - 0s 1ms/step - loss: 29.8735

3/3 [==============================] - 0s 45ms/step - loss: 29.8735 - val_loss: 30.0693
Epoch 28/30

1/3 [=========>....................] - ETA: 0s - loss: 30.3087
3/3 [==============================] - 0s 997us/step - loss: 29.6421

3/3 [==============================] - 0s 46ms/step - loss: 29.6421 - val_loss: 29.8475
Epoch 29/30

1/3 [=========>....................] - ETA: 0s - loss: 28.4288
3/3 [==============================] - 0s 1ms/step - loss: 29.4046

3/3 [==============================] - 0s 47ms/step - loss: 29.4046 - val_loss: 29.6481
Epoch 30/30

1/3 [=========>....................] - ETA: 0s - loss: 29.6374
3/3 [==============================] - 0s 1ms/step - loss: 29.1717

3/3 [==============================] - 0s 47ms/step - loss: 29.1717 - val_loss: 29.4434

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-02T19-39-21Z

Training run 6/8 (flags = list(392, 0.05, 500, 100, "sigmoid")) 
Using run directory runs/2020-11-02T19-39-26Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = dim(hitters_scale_train)[2]) %>%
+         layer_ .... [TRUNCATED] 

> set.seed(1)

> model %>% compile (
+         loss = 'mse',
+         optimizer = optimizer_sgd(lr=FLAGS$learning_rate))

> model %>% fit (x = as.matrix(hitters_scale_train), y = hitters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = .... [TRUNCATED] 
Epoch 1/100

1/1 [==============================] - 0s 11us/step - loss: 38.5676

1/1 [==============================] - 1s 692ms/step - loss: 38.5676 - val_loss: 4415.9268
Epoch 2/100

1/1 [==============================] - 0s 12us/step - loss: 4428.5933

1/1 [==============================] - 0s 137ms/step - loss: 4428.5933 - val_loss: 151.3512
Epoch 3/100

1/1 [==============================] - 0s 13us/step - loss: 149.1063

1/1 [==============================] - 0s 134ms/step - loss: 149.1063 - val_loss: 118.9645
Epoch 4/100

1/1 [==============================] - 0s 15us/step - loss: 116.9800

1/1 [==============================] - 0s 149ms/step - loss: 116.9800 - val_loss: 96.6139
Epoch 5/100

1/1 [==============================] - 0s 14us/step - loss: 94.8349

1/1 [==============================] - 0s 137ms/step - loss: 94.8349 - val_loss: 78.5241
Epoch 6/100

1/1 [==============================] - 0s 11us/step - loss: 76.9299

1/1 [==============================] - 0s 134ms/step - loss: 76.9299 - val_loss: 63.8693
Epoch 7/100

1/1 [==============================] - 0s 11us/step - loss: 62.4413

1/1 [==============================] - 0s 136ms/step - loss: 62.4413 - val_loss: 51.9917
Epoch 8/100

1/1 [==============================] - 0s 12us/step - loss: 50.7133

1/1 [==============================] - 0s 136ms/step - loss: 50.7133 - val_loss: 42.3621
Epoch 9/100

1/1 [==============================] - 0s 13us/step - loss: 41.2182

1/1 [==============================] - 0s 134ms/step - loss: 41.2182 - val_loss: 34.5530
Epoch 10/100

1/1 [==============================] - 0s 11us/step - loss: 33.5301

1/1 [==============================] - 0s 143ms/step - loss: 33.5301 - val_loss: 28.2186
Epoch 11/100

1/1 [==============================] - 0s 14us/step - loss: 27.3046

1/1 [==============================] - 0s 136ms/step - loss: 27.3046 - val_loss: 23.0793
Epoch 12/100

1/1 [==============================] - 0s 14us/step - loss: 22.2634

1/1 [==============================] - 0s 135ms/step - loss: 22.2634 - val_loss: 18.9086
Epoch 13/100

1/1 [==============================] - 0s 14us/step - loss: 18.1809

1/1 [==============================] - 0s 133ms/step - loss: 18.1809 - val_loss: 15.5231
Epoch 14/100

1/1 [==============================] - 0s 11us/step - loss: 14.8747

1/1 [==============================] - 0s 139ms/step - loss: 14.8747 - val_loss: 12.7742
Epoch 15/100

1/1 [==============================] - 0s 14us/step - loss: 12.1972

1/1 [==============================] - 0s 133ms/step - loss: 12.1972 - val_loss: 10.5415
Epoch 16/100

1/1 [==============================] - 0s 12us/step - loss: 10.0288

1/1 [==============================] - 0s 134ms/step - loss: 10.0288 - val_loss: 8.7276
Epoch 17/100

1/1 [==============================] - 0s 14us/step - loss: 8.2727

1/1 [==============================] - 0s 136ms/step - loss: 8.2727 - val_loss: 7.2532
Epoch 18/100

1/1 [==============================] - 0s 14us/step - loss: 6.8504

1/1 [==============================] - 0s 135ms/step - loss: 6.8504 - val_loss: 6.0545
Epoch 19/100

1/1 [==============================] - 0s 13us/step - loss: 5.6986

1/1 [==============================] - 0s 134ms/step - loss: 5.6986 - val_loss: 5.0795
Epoch 20/100

1/1 [==============================] - 0s 14us/step - loss: 4.7657

1/1 [==============================] - 0s 144ms/step - loss: 4.7657 - val_loss: 4.2860
Epoch 21/100

1/1 [==============================] - 0s 12us/step - loss: 4.0101

1/1 [==============================] - 0s 135ms/step - loss: 4.0101 - val_loss: 3.6400
Epoch 22/100

1/1 [==============================] - 0s 15us/step - loss: 3.3982

1/1 [==============================] - 0s 137ms/step - loss: 3.3982 - val_loss: 3.1136
Epoch 23/100

1/1 [==============================] - 0s 12us/step - loss: 2.9026

1/1 [==============================] - 0s 134ms/step - loss: 2.9026 - val_loss: 2.6846
Epoch 24/100

1/1 [==============================] - 0s 13us/step - loss: 2.5012

1/1 [==============================] - 0s 134ms/step - loss: 2.5012 - val_loss: 2.3346
Epoch 25/100

1/1 [==============================] - 0s 14us/step - loss: 2.1761

1/1 [==============================] - 0s 133ms/step - loss: 2.1761 - val_loss: 2.0489
Epoch 26/100

1/1 [==============================] - 0s 13us/step - loss: 1.9128

1/1 [==============================] - 0s 136ms/step - loss: 1.9128 - val_loss: 1.8155
Epoch 27/100

1/1 [==============================] - 0s 11us/step - loss: 1.6996

1/1 [==============================] - 0s 134ms/step - loss: 1.6996 - val_loss: 1.6247
Epoch 28/100

1/1 [==============================] - 0s 11us/step - loss: 1.5269

1/1 [==============================] - 0s 136ms/step - loss: 1.5269 - val_loss: 1.4685
Epoch 29/100

1/1 [==============================] - 0s 14us/step - loss: 1.3870

1/1 [==============================] - 0s 134ms/step - loss: 1.3870 - val_loss: 1.3405
Epoch 30/100

1/1 [==============================] - 0s 14us/step - loss: 1.2737

1/1 [==============================] - 0s 143ms/step - loss: 1.2737 - val_loss: 1.2355
Epoch 31/100

1/1 [==============================] - 0s 14us/step - loss: 1.1820

1/1 [==============================] - 0s 133ms/step - loss: 1.1820 - val_loss: 1.1493
Epoch 32/100

1/1 [==============================] - 0s 15us/step - loss: 1.1076

1/1 [==============================] - 0s 134ms/step - loss: 1.1076 - val_loss: 1.0784
Epoch 33/100

1/1 [==============================] - 0s 13us/step - loss: 1.0474

1/1 [==============================] - 0s 134ms/step - loss: 1.0474 - val_loss: 1.0200
Epoch 34/100

1/1 [==============================] - 0s 18us/step - loss: 0.9987

1/1 [==============================] - 0s 135ms/step - loss: 0.9987 - val_loss: 0.9719
Epoch 35/100

1/1 [==============================] - 0s 12us/step - loss: 0.9592

1/1 [==============================] - 0s 140ms/step - loss: 0.9592 - val_loss: 0.9321
Epoch 36/100

1/1 [==============================] - 0s 14us/step - loss: 0.9272

1/1 [==============================] - 0s 137ms/step - loss: 0.9272 - val_loss: 0.8992
Epoch 37/100

1/1 [==============================] - 0s 14us/step - loss: 0.9013

1/1 [==============================] - 0s 134ms/step - loss: 0.9013 - val_loss: 0.8719
Epoch 38/100

1/1 [==============================] - 0s 15us/step - loss: 0.8804

1/1 [==============================] - 0s 136ms/step - loss: 0.8804 - val_loss: 0.8492
Epoch 39/100

1/1 [==============================] - 0s 14us/step - loss: 0.8634

1/1 [==============================] - 0s 142ms/step - loss: 0.8634 - val_loss: 0.8303
Epoch 40/100

1/1 [==============================] - 0s 13us/step - loss: 0.8496

1/1 [==============================] - 0s 134ms/step - loss: 0.8496 - val_loss: 0.8145
Epoch 41/100

1/1 [==============================] - 0s 13us/step - loss: 0.8385

1/1 [==============================] - 0s 134ms/step - loss: 0.8385 - val_loss: 0.8014
Epoch 42/100

1/1 [==============================] - 0s 25us/step - loss: 0.8294

1/1 [==============================] - 0s 138ms/step - loss: 0.8294 - val_loss: 0.7903
Epoch 43/100

1/1 [==============================] - 0s 12us/step - loss: 0.8221

1/1 [==============================] - 0s 134ms/step - loss: 0.8221 - val_loss: 0.7811
Epoch 44/100

1/1 [==============================] - 0s 11us/step - loss: 0.8162

1/1 [==============================] - 0s 133ms/step - loss: 0.8162 - val_loss: 0.7732
Epoch 45/100

1/1 [==============================] - 0s 14us/step - loss: 0.8114

1/1 [==============================] - 0s 137ms/step - loss: 0.8114 - val_loss: 0.7666
Epoch 46/100

1/1 [==============================] - 0s 13us/step - loss: 0.8075

1/1 [==============================] - 0s 135ms/step - loss: 0.8075 - val_loss: 0.7610
Epoch 47/100

1/1 [==============================] - 0s 13us/step - loss: 0.8044

1/1 [==============================] - 0s 134ms/step - loss: 0.8044 - val_loss: 0.7563
Epoch 48/100

1/1 [==============================] - 0s 13us/step - loss: 0.8018

1/1 [==============================] - 0s 134ms/step - loss: 0.8018 - val_loss: 0.7522
Epoch 49/100

1/1 [==============================] - 0s 10us/step - loss: 0.7998

1/1 [==============================] - 0s 142ms/step - loss: 0.7998 - val_loss: 0.7488
Epoch 50/100

1/1 [==============================] - 0s 15us/step - loss: 0.7981

1/1 [==============================] - 0s 134ms/step - loss: 0.7981 - val_loss: 0.7458
Epoch 51/100

1/1 [==============================] - 0s 12us/step - loss: 0.7967

1/1 [==============================] - 0s 133ms/step - loss: 0.7967 - val_loss: 0.7433
Epoch 52/100

1/1 [==============================] - 0s 14us/step - loss: 0.7956

1/1 [==============================] - 0s 136ms/step - loss: 0.7956 - val_loss: 0.7411
Epoch 53/100

1/1 [==============================] - 0s 13us/step - loss: 0.7948

1/1 [==============================] - 0s 136ms/step - loss: 0.7948 - val_loss: 0.7392
Epoch 54/100

1/1 [==============================] - 0s 13us/step - loss: 0.7940

1/1 [==============================] - 0s 139ms/step - loss: 0.7940 - val_loss: 0.7376
Epoch 55/100

1/1 [==============================] - 0s 13us/step - loss: 0.7934

1/1 [==============================] - 0s 133ms/step - loss: 0.7934 - val_loss: 0.7361
Epoch 56/100

1/1 [==============================] - 0s 11us/step - loss: 0.7930

1/1 [==============================] - 0s 151ms/step - loss: 0.7930 - val_loss: 0.7349
Epoch 57/100

1/1 [==============================] - 0s 14us/step - loss: 0.7926

1/1 [==============================] - 0s 138ms/step - loss: 0.7926 - val_loss: 0.7338
Epoch 58/100

1/1 [==============================] - 0s 14us/step - loss: 0.7923

1/1 [==============================] - 0s 135ms/step - loss: 0.7923 - val_loss: 0.7329
Epoch 59/100

1/1 [==============================] - 0s 13us/step - loss: 0.7920

1/1 [==============================] - 0s 143ms/step - loss: 0.7920 - val_loss: 0.7321
Epoch 60/100

1/1 [==============================] - 0s 12us/step - loss: 0.7918

1/1 [==============================] - 0s 134ms/step - loss: 0.7918 - val_loss: 0.7313
Epoch 61/100

1/1 [==============================] - 0s 11us/step - loss: 0.7917

1/1 [==============================] - 0s 136ms/step - loss: 0.7917 - val_loss: 0.7307
Epoch 62/100

1/1 [==============================] - 0s 13us/step - loss: 0.7915

1/1 [==============================] - 0s 134ms/step - loss: 0.7915 - val_loss: 0.7301
Epoch 63/100

1/1 [==============================] - 0s 11us/step - loss: 0.7914

1/1 [==============================] - 0s 134ms/step - loss: 0.7914 - val_loss: 0.7297
Epoch 64/100

1/1 [==============================] - 0s 12us/step - loss: 0.7913

1/1 [==============================] - 0s 135ms/step - loss: 0.7913 - val_loss: 0.7292
Epoch 65/100

1/1 [==============================] - 0s 13us/step - loss: 0.7913

1/1 [==============================] - 0s 138ms/step - loss: 0.7913 - val_loss: 0.7288
Epoch 66/100

1/1 [==============================] - 0s 14us/step - loss: 0.7912

1/1 [==============================] - 0s 137ms/step - loss: 0.7912 - val_loss: 0.7285
Epoch 67/100

1/1 [==============================] - 0s 13us/step - loss: 0.7912

1/1 [==============================] - 0s 138ms/step - loss: 0.7912 - val_loss: 0.7282
Epoch 68/100

1/1 [==============================] - 0s 14us/step - loss: 0.7911

1/1 [==============================] - 0s 143ms/step - loss: 0.7911 - val_loss: 0.7279
Epoch 69/100

1/1 [==============================] - 0s 12us/step - loss: 0.7911

1/1 [==============================] - 0s 133ms/step - loss: 0.7911 - val_loss: 0.7277
Epoch 70/100

1/1 [==============================] - 0s 11us/step - loss: 0.7911

1/1 [==============================] - 0s 134ms/step - loss: 0.7911 - val_loss: 0.7274
Epoch 71/100

1/1 [==============================] - 0s 14us/step - loss: 0.7911

1/1 [==============================] - 0s 134ms/step - loss: 0.7911 - val_loss: 0.7273
Epoch 72/100

1/1 [==============================] - 0s 13us/step - loss: 0.7910

1/1 [==============================] - 0s 136ms/step - loss: 0.7910 - val_loss: 0.7271
Epoch 73/100

1/1 [==============================] - 0s 14us/step - loss: 0.7910

1/1 [==============================] - 0s 136ms/step - loss: 0.7910 - val_loss: 0.7269
Epoch 74/100

1/1 [==============================] - 0s 14us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7268
Epoch 75/100

1/1 [==============================] - 0s 14us/step - loss: 0.7910

1/1 [==============================] - 0s 138ms/step - loss: 0.7910 - val_loss: 0.7267
Epoch 76/100

1/1 [==============================] - 0s 13us/step - loss: 0.7910

1/1 [==============================] - 0s 134ms/step - loss: 0.7910 - val_loss: 0.7266
Epoch 77/100

1/1 [==============================] - 0s 11us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7265
Epoch 78/100

1/1 [==============================] - 0s 16us/step - loss: 0.7910

1/1 [==============================] - 0s 144ms/step - loss: 0.7910 - val_loss: 0.7264
Epoch 79/100

1/1 [==============================] - 0s 11us/step - loss: 0.7910

1/1 [==============================] - 0s 133ms/step - loss: 0.7910 - val_loss: 0.7263
Epoch 80/100

1/1 [==============================] - 0s 13us/step - loss: 0.7910

1/1 [==============================] - 0s 134ms/step - loss: 0.7910 - val_loss: 0.7262
Epoch 81/100

1/1 [==============================] - 0s 11us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7262
Epoch 82/100

1/1 [==============================] - 0s 14us/step - loss: 0.7910

1/1 [==============================] - 0s 136ms/step - loss: 0.7910 - val_loss: 0.7261
Epoch 83/100

1/1 [==============================] - 0s 17us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7261
Epoch 84/100

1/1 [==============================] - 0s 11us/step - loss: 0.7910

1/1 [==============================] - 0s 133ms/step - loss: 0.7910 - val_loss: 0.7260
Epoch 85/100

1/1 [==============================] - 0s 14us/step - loss: 0.7910

1/1 [==============================] - 0s 138ms/step - loss: 0.7910 - val_loss: 0.7260
Epoch 86/100

1/1 [==============================] - 0s 14us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7259
Epoch 87/100

1/1 [==============================] - 0s 12us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7259
Epoch 88/100

1/1 [==============================] - 0s 14us/step - loss: 0.7910

1/1 [==============================] - 0s 143ms/step - loss: 0.7910 - val_loss: 0.7259
Epoch 89/100

1/1 [==============================] - 0s 13us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7258
Epoch 90/100

1/1 [==============================] - 0s 14us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7258
Epoch 91/100

1/1 [==============================] - 0s 11us/step - loss: 0.7910

1/1 [==============================] - 0s 133ms/step - loss: 0.7910 - val_loss: 0.7258
Epoch 92/100

1/1 [==============================] - 0s 11us/step - loss: 0.7910

1/1 [==============================] - 0s 136ms/step - loss: 0.7910 - val_loss: 0.7258
Epoch 93/100

1/1 [==============================] - 0s 15us/step - loss: 0.7910

1/1 [==============================] - 0s 135ms/step - loss: 0.7910 - val_loss: 0.7258
Epoch 94/100

1/1 [==============================] - 0s 11us/step - loss: 0.7910

1/1 [==============================] - 0s 132ms/step - loss: 0.7910 - val_loss: 0.7257
Epoch 95/100

1/1 [==============================] - 0s 29us/step - loss: 0.7910

1/1 [==============================] - 0s 133ms/step - loss: 0.7910 - val_loss: 0.7257
Epoch 96/100

1/1 [==============================] - 0s 13us/step - loss: 0.7910

1/1 [==============================] - 0s 136ms/step - loss: 0.7910 - val_loss: 0.7257
Epoch 97/100

1/1 [==============================] - 0s 13us/step - loss: 0.7910

1/1 [==============================] - 0s 142ms/step - loss: 0.7910 - val_loss: 0.7257
Epoch 98/100

1/1 [==============================] - 0s 11us/step - loss: 0.7910

1/1 [==============================] - 0s 132ms/step - loss: 0.7910 - val_loss: 0.7257
Epoch 99/100

1/1 [==============================] - 0s 37us/step - loss: 0.7910

1/1 [==============================] - 0s 138ms/step - loss: 0.7910 - val_loss: 0.7257
Epoch 100/100

1/1 [==============================] - 0s 17us/step - loss: 0.7910

1/1 [==============================] - 0s 137ms/step - loss: 0.7910 - val_loss: 0.7257

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-02T19-39-26Z

Training run 7/8 (flags = list(64, 0.001, 1000, 30, "sigmoid")) 
Using run directory runs/2020-11-02T19-39-41Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = dim(hitters_scale_train)[2]) %>%
+         layer_ .... [TRUNCATED] 

> set.seed(1)

> model %>% compile (
+         loss = 'mse',
+         optimizer = optimizer_sgd(lr=FLAGS$learning_rate))

> model %>% fit (x = as.matrix(hitters_scale_train), y = hitters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = .... [TRUNCATED] 
Epoch 1/30

1/1 [==============================] - 0s 11us/step - loss: 45.0582

1/1 [==============================] - 1s 578ms/step - loss: 45.0582 - val_loss: 42.6221
Epoch 2/30

1/1 [==============================] - 0s 16us/step - loss: 41.4483

1/1 [==============================] - 0s 136ms/step - loss: 41.4483 - val_loss: 39.2637
Epoch 3/30

1/1 [==============================] - 0s 17us/step - loss: 38.1376

1/1 [==============================] - 0s 140ms/step - loss: 38.1376 - val_loss: 36.1791
Epoch 4/30

1/1 [==============================] - 0s 15us/step - loss: 35.0990

1/1 [==============================] - 0s 137ms/step - loss: 35.0990 - val_loss: 33.3439
Epoch 5/30

1/1 [==============================] - 0s 15us/step - loss: 32.3081

1/1 [==============================] - 0s 136ms/step - loss: 32.3081 - val_loss: 30.7363
Epoch 6/30

1/1 [==============================] - 0s 15us/step - loss: 29.7433

1/1 [==============================] - 0s 136ms/step - loss: 29.7433 - val_loss: 28.3371
Epoch 7/30

1/1 [==============================] - 0s 9us/step - loss: 27.3853

1/1 [==============================] - 0s 131ms/step - loss: 27.3853 - val_loss: 26.1286
Epoch 8/30

1/1 [==============================] - 0s 11us/step - loss: 25.2166

1/1 [==============================] - 0s 130ms/step - loss: 25.2166 - val_loss: 24.0952
Epoch 9/30

1/1 [==============================] - 0s 10us/step - loss: 23.2216

1/1 [==============================] - 0s 139ms/step - loss: 23.2216 - val_loss: 22.2227
Epoch 10/30

1/1 [==============================] - 0s 13us/step - loss: 21.3861

1/1 [==============================] - 0s 135ms/step - loss: 21.3861 - val_loss: 20.4980
Epoch 11/30

1/1 [==============================] - 0s 11us/step - loss: 19.6971

1/1 [==============================] - 0s 136ms/step - loss: 19.6971 - val_loss: 18.9095
Epoch 12/30

1/1 [==============================] - 0s 13us/step - loss: 18.1431

1/1 [==============================] - 0s 133ms/step - loss: 18.1431 - val_loss: 17.4464
Epoch 13/30

1/1 [==============================] - 0s 11us/step - loss: 16.7132

1/1 [==============================] - 0s 136ms/step - loss: 16.7132 - val_loss: 16.0988
Epoch 14/30

1/1 [==============================] - 0s 12us/step - loss: 15.3977

1/1 [==============================] - 0s 134ms/step - loss: 15.3977 - val_loss: 14.8578
Epoch 15/30

1/1 [==============================] - 0s 17us/step - loss: 14.1876

1/1 [==============================] - 0s 136ms/step - loss: 14.1876 - val_loss: 13.7150
Epoch 16/30

1/1 [==============================] - 0s 19us/step - loss: 13.0746

1/1 [==============================] - 0s 137ms/step - loss: 13.0746 - val_loss: 12.6629
Epoch 17/30

1/1 [==============================] - 0s 15us/step - loss: 12.0511

1/1 [==============================] - 0s 136ms/step - loss: 12.0511 - val_loss: 11.6943
Epoch 18/30

1/1 [==============================] - 0s 16us/step - loss: 11.1102

1/1 [==============================] - 0s 135ms/step - loss: 11.1102 - val_loss: 10.8030
Epoch 19/30

1/1 [==============================] - 0s 15us/step - loss: 10.2455

1/1 [==============================] - 0s 141ms/step - loss: 10.2455 - val_loss: 9.9828
Epoch 20/30

1/1 [==============================] - 0s 15us/step - loss: 9.4510

1/1 [==============================] - 0s 135ms/step - loss: 9.4510 - val_loss: 9.2283
Epoch 21/30

1/1 [==============================] - 0s 9us/step - loss: 8.7212

1/1 [==============================] - 0s 134ms/step - loss: 8.7212 - val_loss: 8.5344
Epoch 22/30

1/1 [==============================] - 0s 18us/step - loss: 8.0510

1/1 [==============================] - 0s 134ms/step - loss: 8.0510 - val_loss: 7.8963
Epoch 23/30

1/1 [==============================] - 0s 13us/step - loss: 7.4359

1/1 [==============================] - 0s 132ms/step - loss: 7.4359 - val_loss: 7.3098
Epoch 24/30

1/1 [==============================] - 0s 9us/step - loss: 6.8713

1/1 [==============================] - 0s 132ms/step - loss: 6.8713 - val_loss: 6.7708
Epoch 25/30

1/1 [==============================] - 0s 10us/step - loss: 6.3534

1/1 [==============================] - 0s 132ms/step - loss: 6.3534 - val_loss: 6.2756
Epoch 26/30

1/1 [==============================] - 0s 11us/step - loss: 5.8785

1/1 [==============================] - 0s 134ms/step - loss: 5.8785 - val_loss: 5.8207
Epoch 27/30

1/1 [==============================] - 0s 17us/step - loss: 5.4431

1/1 [==============================] - 0s 136ms/step - loss: 5.4431 - val_loss: 5.4029
Epoch 28/30

1/1 [==============================] - 0s 16us/step - loss: 5.0441

1/1 [==============================] - 0s 141ms/step - loss: 5.0441 - val_loss: 5.0194
Epoch 29/30

1/1 [==============================] - 0s 11us/step - loss: 4.6786

1/1 [==============================] - 0s 135ms/step - loss: 4.6786 - val_loss: 4.6673
Epoch 30/30

1/1 [==============================] - 0s 20us/step - loss: 4.3438

1/1 [==============================] - 0s 137ms/step - loss: 4.3438 - val_loss: 4.3442

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-02T19-39-41Z

Training run 8/8 (flags = list(64, 0.001, 200, 30, "tanh")) 
Using run directory runs/2020-11-02T19-39-46Z

> FLAGS <- flags(
+         flag_numeric("nodes", 50),
+         flag_numeric("batch_size", 100),
+         flag_string("activation", "relu"),
+       .... [TRUNCATED] 

> model <- keras_model_sequential()

> model %>%
+         layer_dense( units = FLAGS$nodes, activation = FLAGS$activation, input_shape = dim(hitters_scale_train)[2]) %>%
+         layer_ .... [TRUNCATED] 

> set.seed(1)

> model %>% compile (
+         loss = 'mse',
+         optimizer = optimizer_sgd(lr=FLAGS$learning_rate))

> model %>% fit (x = as.matrix(hitters_scale_train), y = hitters_train_labels, epochs = FLAGS$epochs, batch_size = FLAGS$batch_size, validation_data = .... [TRUNCATED] 
Epoch 1/30

1/2 [==============>...............] - ETA: 0s - loss: 37.7147
2/2 [==============================] - 0s 727us/step - loss: 37.9011

2/2 [==============================] - 1s 291ms/step - loss: 37.9011 - val_loss: 36.3405
Epoch 2/30

1/2 [==============>...............] - ETA: 0s - loss: 35.7724
2/2 [==============================] - 0s 1ms/step - loss: 35.8196

2/2 [==============================] - 0s 71ms/step - loss: 35.8196 - val_loss: 34.7922
Epoch 3/30

1/2 [==============>...............] - ETA: 0s - loss: 33.8228
2/2 [==============================] - 0s 798us/step - loss: 33.8059

2/2 [==============================] - 0s 70ms/step - loss: 33.8059 - val_loss: 33.2080
Epoch 4/30

1/2 [==============>...............] - ETA: 0s - loss: 32.2774
2/2 [==============================] - 0s 1ms/step - loss: 32.1180

2/2 [==============================] - 0s 71ms/step - loss: 32.1180 - val_loss: 31.7447
Epoch 5/30

1/2 [==============>...............] - ETA: 0s - loss: 30.6944
2/2 [==============================] - 0s 928us/step - loss: 30.3946

2/2 [==============================] - 0s 72ms/step - loss: 30.3946 - val_loss: 30.2341
Epoch 6/30

1/2 [==============>...............] - ETA: 0s - loss: 28.8608
2/2 [==============================] - 0s 1ms/step - loss: 28.7849

2/2 [==============================] - 0s 68ms/step - loss: 28.7849 - val_loss: 28.8368
Epoch 7/30

1/2 [==============>...............] - ETA: 0s - loss: 27.1999
2/2 [==============================] - 0s 764us/step - loss: 27.1317

2/2 [==============================] - 0s 68ms/step - loss: 27.1317 - val_loss: 27.5972
Epoch 8/30

1/2 [==============>...............] - ETA: 0s - loss: 25.3265
2/2 [==============================] - 0s 874us/step - loss: 25.4889

2/2 [==============================] - 0s 68ms/step - loss: 25.4889 - val_loss: 26.0265
Epoch 9/30

1/2 [==============>...............] - ETA: 0s - loss: 23.8127
2/2 [==============================] - 0s 822us/step - loss: 23.8960

2/2 [==============================] - 0s 68ms/step - loss: 23.8960 - val_loss: 24.4745
Epoch 10/30

1/2 [==============>...............] - ETA: 0s - loss: 22.5028
2/2 [==============================] - 0s 816us/step - loss: 22.3516

2/2 [==============================] - 0s 70ms/step - loss: 22.3516 - val_loss: 23.0624
Epoch 11/30

1/2 [==============>...............] - ETA: 0s - loss: 21.0304
2/2 [==============================] - 0s 906us/step - loss: 20.8613

2/2 [==============================] - 0s 68ms/step - loss: 20.8613 - val_loss: 21.7092
Epoch 12/30

1/2 [==============>...............] - ETA: 0s - loss: 19.5360
2/2 [==============================] - 0s 721us/step - loss: 19.4177

2/2 [==============================] - 0s 68ms/step - loss: 19.4177 - val_loss: 20.3435
Epoch 13/30

1/2 [==============>...............] - ETA: 0s - loss: 18.2716
2/2 [==============================] - 0s 955us/step - loss: 17.9488

2/2 [==============================] - 0s 68ms/step - loss: 17.9488 - val_loss: 19.2287
Epoch 14/30

1/2 [==============>...............] - ETA: 0s - loss: 16.6198
2/2 [==============================] - 0s 1ms/step - loss: 16.6304

2/2 [==============================] - 0s 68ms/step - loss: 16.6304 - val_loss: 17.8024
Epoch 15/30

1/2 [==============>...............] - ETA: 0s - loss: 15.3170
2/2 [==============================] - 0s 900us/step - loss: 15.2614

2/2 [==============================] - 0s 67ms/step - loss: 15.2614 - val_loss: 16.3983
Epoch 16/30

1/2 [==============>...............] - ETA: 0s - loss: 14.0793
2/2 [==============================] - 0s 591us/step - loss: 13.9897

2/2 [==============================] - 0s 67ms/step - loss: 13.9897 - val_loss: 15.2999
Epoch 17/30

1/2 [==============>...............] - ETA: 0s - loss: 12.9916
2/2 [==============================] - 0s 623us/step - loss: 12.7835

2/2 [==============================] - 0s 67ms/step - loss: 12.7835 - val_loss: 14.2970
Epoch 18/30

1/2 [==============>...............] - ETA: 0s - loss: 11.5383
2/2 [==============================] - 0s 785us/step - loss: 11.5838

2/2 [==============================] - 0s 69ms/step - loss: 11.5838 - val_loss: 12.9356
Epoch 19/30

1/2 [==============>...............] - ETA: 0s - loss: 10.4690
2/2 [==============================] - 0s 857us/step - loss: 10.3876

2/2 [==============================] - 0s 69ms/step - loss: 10.3876 - val_loss: 11.9494
Epoch 20/30

1/2 [==============>...............] - ETA: 0s - loss: 9.4706
2/2 [==============================] - 0s 988us/step - loss: 9.3483

2/2 [==============================] - 0s 70ms/step - loss: 9.3483 - val_loss: 10.6828
Epoch 21/30

1/2 [==============>...............] - ETA: 0s - loss: 8.5980
2/2 [==============================] - 0s 877us/step - loss: 8.3562

2/2 [==============================] - 0s 68ms/step - loss: 8.3562 - val_loss: 9.8885
Epoch 22/30

1/2 [==============>...............] - ETA: 0s - loss: 7.8175
2/2 [==============================] - 0s 800us/step - loss: 7.5959

2/2 [==============================] - 0s 68ms/step - loss: 7.5959 - val_loss: 9.0446
Epoch 23/30

1/2 [==============>...............] - ETA: 0s - loss: 6.9850
2/2 [==============================] - 0s 922us/step - loss: 6.8576

2/2 [==============================] - 0s 69ms/step - loss: 6.8576 - val_loss: 8.2814
Epoch 24/30

1/2 [==============>...............] - ETA: 0s - loss: 6.2094
2/2 [==============================] - 0s 834us/step - loss: 6.1709

2/2 [==============================] - 0s 68ms/step - loss: 6.1709 - val_loss: 7.5660
Epoch 25/30

1/2 [==============>...............] - ETA: 0s - loss: 5.4239
2/2 [==============================] - 0s 831us/step - loss: 5.4941

2/2 [==============================] - 0s 69ms/step - loss: 5.4941 - val_loss: 6.8004
Epoch 26/30

1/2 [==============>...............] - ETA: 0s - loss: 5.0382
2/2 [==============================] - 0s 1ms/step - loss: 4.9161

2/2 [==============================] - 0s 69ms/step - loss: 4.9161 - val_loss: 6.1897
Epoch 27/30

1/2 [==============>...............] - ETA: 0s - loss: 4.4073
2/2 [==============================] - 0s 989us/step - loss: 4.3986

2/2 [==============================] - 0s 68ms/step - loss: 4.3986 - val_loss: 5.4900
Epoch 28/30

1/2 [==============>...............] - ETA: 0s - loss: 3.8023
2/2 [==============================] - 0s 754us/step - loss: 3.8884

2/2 [==============================] - 0s 67ms/step - loss: 3.8884 - val_loss: 4.9387
Epoch 29/30

1/2 [==============>...............] - ETA: 0s - loss: 3.5314
2/2 [==============================] - 0s 788us/step - loss: 3.4492

2/2 [==============================] - 0s 71ms/step - loss: 3.4492 - val_loss: 4.5482
Epoch 30/30

1/2 [==============>...............] - ETA: 0s - loss: 3.0471
2/2 [==============================] - 0s 904us/step - loss: 3.1376

2/2 [==============================] - 0s 68ms/step - loss: 3.1376 - val_loss: 4.0796

Error occurred resetting tf graph: AttributeError: module 'tensorflow' has no attribute 'reset_default_graph'
Run completed: runs/2020-11-02T19-39-46Z

runs

Data frame: 8 x 23 

# ... with 20 more columns:
#   flag_nodes, flag_batch_size, flag_activation, flag_learning_rate, flag_epochs,
#   epochs, epochs_completed, metrics, model, loss_function, optimizer,
#   learning_rate, script, start, end, completed, output, source_code, context, type

• Print the returned value from tf_runs to see the metrics for each run. Which run ( which hyper-parameter combination) gave the best mean squared error on the validation data?

The combination from the third run

• Print the learning curve for your best model. Does your best model still overfit?

Yes, the validation loss is less than the metric loss

• Does your validation_loss stop decreasing after several epochs? If so, at roughly which epoch does your validation_loss stop decreasing?

Yes, it stops decreasing at the 94th epoch.

10. (5 pt) Measure the performance of your best model (after tuning) on the test set and compute its RMSE. Note that you must reverse the log transformation by taking the exp (exponent) of the predictions returned by the neural network model and compare it to the original salary value ( without log transformation). Doing this, helps us get the RMSE in the original scale.